Adding AI, Not Starting Over
How an experienced engineer can start building AI-powered solutions
AI is changing what's expected of software engineers, and you don't need to switch careers to keep up. You can become an engineer who builds AI-powered solutions, on top of the work you already do. Here's the approach that worked when I tried it.
“AI Engineering” has two words, and everyone fixates on the first. But the engineering half — data, APIs, validation, deployment, cost, security — is the work you already do every day. The AIhalf is a learnable stack: prompting models well, grounding them in your own data with retrieval (RAG), building agents that take actions, and adding the guardrails and evaluation that make them reliable. Most AI tutorials stop at a notebook that works once; turning that into a dependable, shippable feature is exactly what an experienced engineer is good at. So it's not starting over — it's adding a new layer on top of a foundation you already have.
I did this from a .NET background. I used Python because I already knew it and that's where most AI tooling lives — but you don't have to switch languages: a lot of this works in .NET too, and I'll share a .NET version soon. The route was six stages, each with a small real project that builds toward shipping an AI-powered solution:
- Working with data — whole datasets, not row-by-row loops
- Data engineering — pipelines and validation (your SQL pays off here)
- Embeddings & search — comparing text by meaning, not keywords
- RAG — grounding a model in your own data so it stops guessing
- Orchestration & evaluation — composing the pieces, and checking they're any good
- Agents & guardrails — letting the model take actions, and keeping it reliable
- Shipping it — APIs, containers, caching: turning a notebook into a product
The AI half isn't one trick — it's a progression. You learn to prompt a model well, to ground it in your own data with retrieval (RAG) so it doesn't make things up, to let it act as an agent that uses tools and takes steps, and to wrap the whole thing in guardrails and evaluation so it's reliable enough to ship. That arc — from a single prompt to a dependable AI-powered solution — is what an AI Engineer actually builds.
What mattered most wasn't the models or the frameworks — it was the engineering discipline I already had. AI is the layer you add; the engineering is what makes it real and production-ready.
Working with Data
Whole datasets, not row-by-row loops. NumPy, pandas, and thinking in vectors.
Data Engineering
Pipelines and validation — your SQL intuition pays off here.
Embeddings & Search
Comparing text by meaning, not keywords. Vector similarity and nearest-neighbour search.
A RAG Project
Building the retrieval-augmented generation system end-to-end with a real dataset.
Orchestration & Evaluation
Making it conversational and checking it's actually any good — evaluation frameworks.
Agents
Letting the model decide what to do, not just answer. Tool use and multi-step reasoning.
Shipping It
APIs, containers, caching, cost control — turning a notebook into a real product.