1142 Director Software jobs in Menomonee Falls,WI

Assistant Director, Software Engineering-Real Estate

Northwestern Mutual

Milwaukee, WI 53215

Flexible Schedule

Jobcase

Program Director

Diverse Lynx

Milwaukee, WI 53202

Apply Directly

Sr. Software Engineer

Johnson Controls

Glendale, WI 53209

OnsiteHealth InsurancePaid Time OffRetirement Benefit

We are looking for a senior engineer who has shipped AI/ML and GenAI systems in production and can operate as a technical leader within a product scrum team.
7+ years of software engineering experience, with at least 5 years building and deploying AI/ML systems in production
Hands-on experience with the full ML lifecycle: data preparation, model training, evaluation, deployment, monitoring, and retraining
Strong foundation in machine learning fundamentals — supervised/unsupervised learning, time-series modeling, anomaly detection, and predictive analytics
Proficiency in Python and relevant ML frameworks (PyTorch, TensorFlow, scikit-learn, or equivalent)
Experience with MLOps tooling: experiment tracking, model registries, deployment pipelines, and observability
Hands-on experience building production applications across multiple LLM providers (e.g., Anthropic, OpenAI, AWS Bedrock, Azure OpenAI, and open-source models)
Working knowledge of RAG architectures, vector databases, embedding pipelines, and retrieval strategies
Experience with agentic frameworks, multi-agent orchestration, and tool-calling patterns — including emerging standards like Model Context Protocol (MCP) (e.g., LangGraph, CrewAI, LlamaIndex, or custom implementations)
Strong evaluation discipline: ability to design, run, and reason about LLM evaluation pipelines — including eval datasets, LLM-as-judge techniques, and regression testing for prompts and model behavior
Experience with LLM observability and tracing — instrumenting model calls, tool calls, and retrievals in production (e.g., LangSmith, LangFuse, or OpenTelemetry GenAI conventions)
Strong software engineering fundamentals: clean code, system design, API development, and distributed systems
Experience with cloud platforms (Azure preferred) and containerized deployment (Docker, Kubernetes)
Comfortable working in an agile scrum team — shipping iteratively, participating in design reviews, and writing code others can maintain
Ability to communicate technical concepts clearly to non-technical stakeholders and influence product decisions with data