Open Positions/Artificial Intelligence Engineer
Software Engineer | Annapolis Junction, MD - Hybrid | $120,000 - $250,000+ New 2+ years exp PythonLarge language modelsModel inference APIsMulti-agent systems
The AI Engineer will work closely with system and software engineers to design, prototype, and integrate AI-enabled capabilities into the existing architecture. This role centers on applying existing large language models (LLMs) to real mission workflows rather than training new models. The AI Engineer will build agentic solutions, systems of coordinated AI agents and prompts, that automate tasks currently performed manually, streamline authoring and reporting workflows, and enhance the overall effectiveness of intelligence operations.
What you'll do
- Agentic Solution Design & Development: Lead the design and development of AI-driven solutions from conception to deployment, building multi-agent workflows in which coordinated agents and prompts work together to produce outputs supporting reporting and dissemination. This includes prototyping, writing production-quality code, and maintaining deployed AI capabilities.
- LLM Integration: Integrate existing foundation models into the project's architecture via APIs and orchestration frameworks, selecting the right model and approach for each task rather than building models from scratch.
- Prompt Engineering & Workflow Automation: Design, test, and refine prompts and agent instructions to reliably automate manual tasks, and decompose complex mission workflows into discrete steps an agent pipeline can execute.
- Evaluation & Reliability: Develop robust testing, evaluation, and validation strategies for AI-generated outputs, ensuring accuracy, consistency, and appropriate handling of edge cases before outputs reach analysts and reports.
- Collaboration & Communication: Serve as a key technical liaison, collaborating with cross-functional teams including system engineers, software developers, and domain experts. Effectively present and articulate recommended AI approaches, discussing the tradeoffs and implications of different implementations with both technical and non-technical stakeholders.
- Continuous Improvement: Stay current with the rapidly evolving LLM and agentic AI landscape (new models, orchestration frameworks, and tooling), continuously identifying practical opportunities to apply emerging capabilities to the system.
What you'll need
- Bachelor's degree in a related field, or 4 more years of experience in its place. Each degree above a bachelor's counts for 2 years of the experience
- Strong Python development skills, with experience writing production-quality, maintainable code
- Hands-on experience building applications on top of existing LLMs (e.g., via APIs for commercial or self-hosted models)
- Experience designing multi-agent or multi-step AI workflows, including prompt chaining, tool use, and agent orchestration (e.g., LangChain, LlamaIndex, or custom frameworks)
- Strong prompt engineering skills and experience evaluating/validating LLM outputs
- Experience integrating AI capabilities into existing software architectures (RESTful APIs, microservices)
- Experience with the Amazon Web Services (AWS) cloud computing platform
- An active security clearance
Nice to have
- Experience with retrieval-augmented generation (RAG) pipelines and vector databases
- Familiarity with LLM observability and evaluation tooling
- Experience conducting exploratory data analysis on structured and unstructured datasets to prepare inputs for AI workflows
- Familiarity with MLOps/LLMOps practices for deploying and monitoring AI capabilities at scale
- Familiarity with domain knowledge surrounding government agency reporting and dissemination policies
About Captivation
Build something to be proud of.
Captivation creates innovative software solutions for the Armed Forces and the Intelligence Community, in support of missions that matter. Founded in 2014 and based in Hanover, Maryland, we're technical from the top down, and we're trusted to deliver in digital signal processing, big data and streaming analytics, machine learning and artificial intelligence, application development, data visualization and DevOps. We also build products of our own, such as NavWatch, a sensor that detects GPS jamming and spoofing.
We've built our reputation on giving customers exactly what they need, when they need it. Our engineers take pride in what they build and keep looking for a better way to do it. We're looking for the best and brightest: people who get things done and want their work to make a difference.
Pay and benefits
Salary: $120,000 - $250,000+ a year, depending on experience
In addition to great pay and important mission work, everyone at Captivation enjoys:
- An employer 401(k) contribution of up to 20%, with no match required
- A generous HSA contribution
- Flexible paid time off
- Company-paid medical, dental and vision insurance
- Company-paid life and disability insurance
- A learning and development program, through Udemy
This position is open for direct hires only. We will not consider candidates from third-party staffing or recruiting firms.
Apply for this position
Similar positions
- Full Stack Software Engineer New 2+ years exp JavaSpring BootNode.jsAngular
- Platform Engineer New 2+ years exp KubernetesContainerizationJavaSpring Boot
- Technical Requirements AI Systems Engineer New 2+ years exp Systems engineeringAgileRequirements engineeringJira