About this opportunity
DataJobs lists this AI Engineer – Senior Software Engineer opportunity in randolph township, New Jersey. Review the employer’s description below for duties, qualifications and application requirements.
Job description
Converge Squad 2 is hiring a Senior Software Engineer to design, build, and productionize AI-powered solutions across ML, generative AI, and LLM-based systems.
Responsibilities
Design and develop scalable AI-powered applications and services.
Build and integrate Generative AI and LLM capabilities into production applications.
Create AI/ML pipelines covering data preparation, model training, evaluation, deployment, and monitoring.
Work with LLMs, embeddings, vector databases , RAG (Retrieval-Augmented Generation) , prompt engineering, and AI agents.
Design and implement APIs and backend services that connect AI capabilities to existing products and platforms.
Compare models and approaches using accuracy, latency, cost, scalability, and reliability criteria.
Develop strategies for prompt optimization, model evaluation, hallucination reduction, and response quality.
Deliver production-ready systems with observability, logging, monitoring, security controls, and failure handling.
Collaborate with product managers, software engineers, data scientists, and other stakeholders to translate business requirements into technical solutions.
Contribute to architecture and design discussions and help drive technical decisions.
Conduct code reviews and help set engineering best practices.
Mentor other engineers and support technical growth within the team.
Stay current with developments in AI, machine learning, and LLM technologies and identify ways to apply them to products.
Requirements
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
5+ years of professional software engineering experience building and deploying production systems.
Strong programming skills in Python and/or Java .
Strong understanding of software engineering principles, object-oriented design, data structures, algorithms, and system design.
Hands-on experience with Generative AI , LLMs , or machine learning systems.
Experience working with APIs and integrating AI/ML models into applications.
Experience with cloud platforms: AWS , Azure , or Google Cloud .
Experience with databases and data processing systems.
Strong testing and debugging skills, plus experience with CI/CD , version control, and production operations.
Technologies
Python, Java, SQL
Machine Learning, Generative AI, LLMs, NLP
Embeddings, RAG, prompt engineering, model evaluation
LangChain, LlamaIndex, Semantic Kernel
PyTorch, TensorFlow, scikit-learn
REST APIs, microservices, distributed systems
AWS, Azure, Google Cloud
SQL and NoSQL databases, vector databases
Git, CI/CD, Docker, Kubernetes
Monitoring and observability
OpenAI, Anthropic, Gemini
Pinecone, Weaviate, Milvus, OpenSearch, pgvector
scikit-learn, MLOps/LLMOps
Preferred Qualifications
Experience with OpenAI, Anthropic, Gemini, or other foundation models.
Experience building RAG -based applications using embeddings and vector databases.
Experience with vector databases such as Pinecone, Weaviate, Milvus, OpenSearch, or pgvector.
Experience with frameworks such as LangChain, LlamaIndex, or Semantic Kernel.
Experience developing AI agents and tool-using LLM applications.
Experience with ML frameworks such as PyTorch, TensorFlow, or scikit-learn.
Experience with model evaluation, fine-tuning, or parameter-efficient fine-tuning.
Familiarity with MLOps/LLMOps practices.
Experience with Docker, Kubernetes, and cloud-native application development.
Knowledge of AI security, data privacy, responsible AI, and model safety practices.
Experience designing highly scalable distributed systems.
Role Details
Location: Randolph, NJ (onsite)
Employment type: Full-time
Department: Engineering / Artificial Intelligence
Salary: USD 50,000 - 600,000 per yearly
Experience: 5+ years
Additional note: All information is kept confidential according to EEO guidelines.
#J-18808-Ljbffr
Who can apply
Review the original listing for work authorization, qualifications and employer requirements.