About the role
We’re seeking a seasoned engineer to tackle complex software design challenges related to LLM integration and to evolve our core framework.
You may be a good fit for this role if you:
- Develop & Refine: Architect and enhance a Python framework that interfaces with large language models, working closely with our existing AI team.
- Lead & Communicate: Take ownership of technical decisions, collaborate with colleagues, and clearly articulate trade-offs and progress to stakeholders.
What you’ll do here
- Improve Architecture: Design a flexible, efficient, and scalable Python framework for multi-agent orchestration of LLMs.
- Optimize Performance: Utilize concurrency and multithreading to boost throughput and reliability; diagnose and resolve integration bottlenecks.
- Design APIs: Build and iterate high-quality Python APIs for developers to use when building their agentic systems.
- Stay Current: Monitor Python ecosystem trends and LLM advancements; propose and prototype new tools, libraries, and patterns.
- Provide Leadership: Make informed decisions, guide engineering peers, and champion best practices in code quality and documentation.
- Solve Complex Problems: Apply creative, thoughtful design to overcome challenges and outpace larger competitors..
Skills and Qualifications
- BS or MS in Computer Science, Engineering, Statistics, Applied Mathematics, or a related quantitative discipline.
- 5+ years of professional Python development experience, with a strong understanding of object-oriented design and software engineering principles.
- Proven experience building concurrent or multithreaded Python systems.
- Hands-on experience with LLM frameworks (e.g., HuggingFace, LiteLLM, LangChain, LlamaIndex).
- Familiarity with agile methodologies, including version control, Kanban processes, and cloud deployment.
- Contributions to or management of open-source projects is a significant plus.
- Prior experience leading an engineering team is highly desirable.
What we offer
- Stock options and a competitive salary.
- A transit-accessible office location.
- A hybrid work model: two days in-office and three days remote.
- Flexible working hours.
Join our team
We’re always looking for passionate people who want to make an impact. If you think you’d be a great addition to the team, we want to hear from you.