Save Job Back to Search Job Description Summary Similar JobsCollaborate closely with other dedicated Integration specialists, ML engineersfocus of building an AI Middleware for the enterpriseAbout Our ClientWe are looking for a Senior Software Engineer to join our team. You will be a part of an entirely new team getting formed with a laser focus of building an AI Middleware for the enterprise. You'll collaborate closely with other dedicated Software developers, ML engineers and Integration specialists to deliver this platform. For those who excel at navigating intricate, fast-moving projects, overcoming tough technical hurdles, and staying at the forefront of modern web development trends, this opportunity is a perfect fit.Job DescriptionBuild and Operate AI Middleware: Implement, and manage Model Context Protocol (MCP) servers, gateways, and API wrappers that securely expose enterprise systems, tools, and data for AI agent consumption.Build and Govern Agentic Workflows: Deploy and extend agentic AI platforms (e.g., LangGraph, LangChain) to deliver resilient orchestration, enforcing governance, tracing, audit logs, and human-in-the-loop controls.Develop Enterprise Data & Context Pipelines: Build scalable pipelines for parsing, cleaning, embedding, and storing structured and unstructured enterprise data (text, code, multimedia) to enable retrieval-augmented generation and domain-specific agent knowledge.Productize and Optimize AI Services: Translate prototypes into production-grade microservices (Python/TypeScript, Kubernetes, CI/CD), optimizing for latency, throughput, resilience, and token/cost efficiency.Ensure Security, Compliance, and Reliability: Engineer AI middleware and workflows that meet enterprise standards for safety, governance, compliance, and fault tolerance, with built-in monitoring, telemetry, and automated evaluation harnesses.Partner multi-functionally with architects, platform teams, and product owners to deliver business-aligned AI solutions, while staying at the forefront of emerging LLM and middleware trends.The Successful Applicant4+ years of software engineering experience, including approximately 2 years working on ML, data, or LLM-focused systemsProficiency in Python or TypeScript (ideally both) with strong software-engineering fundamentals (testing, design patterns, observability, performance tuning)Practical knowledge of ML/GenAI concepts: embeddings, vector search, prompt engineering, fine-tuning, and evaluation metricsSolid understanding of workflow orchestration frameworks for LLM/GenAI pipelinesHands-on experience with data-pipeline tooling and batch/stream ETLSolid understanding of cloud platforms (AWS preferred), containerization (Docker, Kubernetes), and infrastructure-as-code (Terraform, CDK)Excellent communication skills and a proven ability to collaborate across teams in a fast-paced environmentDomain ExpertiseLLM tooling: LangChain, LangGraph, LlamaIndex, Hugging Face Transformers, OpenAI or Anthropic APIsData stores: Postgres, DynamoDB, Redis, and vector databases such as Pinecone, Weaviate, FAISSObservability: distributed tracing, metrics dashboards, cost monitoring for token-based servicesSecurity & Responsible AI: PII redaction, content-safety filters, bias evaluationBonus: proficiency in Go, experience with multimodal or edge inference, contributions to GenAI open-source projectsWhat's on OfferWe pay a total compensation package which includes a base salary, discretionary performance bonus, and a comprehensive benefits package.ContactRoyce ChanQuote job refJN-012026-6926598Phone number+852 3602 2491Job summaryFunctionITSpecialisationIT DevelopmentWhat is your area of specialisation?Technology & TelecomsLocationWong Chuk HangJob Type:PermanentConsultant nameRoyce ChanConsultant phone+852 3602 2491Job ReferenceJN-012026-6926598