Herd Labs, Inc Founding Engineer (LLM Focus) Remote · Full time

Responsible for maintaining our prompts, tools, agents, and evals.

Description

Job Title: Founding Engineer (LLM Focus)

Job Type: Full-time

Location: Remote (US), NYC Preferred

Salary Range: $150,000 - $250,000 per year


About Herd:

Herd is building a crypto coterminal, where AI agents and humans work together to search, understand, and act onchain. Learn more about us at herd.eco


Job Overview:

As an LLM-focused Founding Engineer at Herd Labs, Inc., you will be responsible for maintaining our prompts, tools, agents, memory, choice of models, and evals. This role is crucial in ensuring users get the best experience navigating and composing onchain objects.


Think of this role as building and maintaining the brain behind different agents at Herd.


Responsibilities:

  • Maintain and optimize our prompts to ensure accurate and timely responses. 
  • Lead the process of testing/choosing the best models for our stack (we currently use plain OpenAI).
  • Develop and enhance tools to improve the performance of our agents, alongside how to manage agent/user memory across objects such as chats, contracts, and communities.
  • Monitor evals to identify areas for improvement and implement necessary changes
  • Lead by example and balance feature output with well-maintained code. We use a mix of Python and Typescript for our end-to-end agent processes.


Requirements:

  • Bachelor's degree in Computer Science, Engineering, or related field
  • Strong proficiency in both Python and Typescript
  • Familiarity with AI-related frameworks such as LangGraph, Instructor, and DSPy. You should be very familiar with the OpenAI Chat Completions API features.
  • Have transacted with at least five different contracts onchain
  • Previous experience at a startup


Nice to Have:

  • You have used Bun on a personal project or in production (we maintain Herd services in a Bun monorepo using NPM workspaces)
  • Experience maintaining your own infrastructure from CI to container orchestration. We are a small team that is constantly looking to improve our infrastructure and tooling
  • Familiarity with EVM (Ethereum Virtual Machine) smart contract data relating to functions, events, and traces. Knowing standard RPC endpoints and tables, such as ERC20 transfers, is a plus.


What we offer:

  • Competitive cash/equity compensation
  • Healthcare
  • High-quality memes


If you have any questions about the company or the role, DM me on Twitter.

Salary

$150,000 - $250,000 per year