GenAI Agent Engineering
Advanced LLM Workflows to Solve Real-World Problems
Develop advanced AI systems by mastering the intricacies of customisation and integration. This module provides the skills to create complex, multi-step interaction workflows using commercial and open-source models. Explore dynamic conversation state management, agent development, multi-modal integration, secure database connections, and advanced fine-tuning methods. Build robust, contextually aware AI solutions tailored for real-world applications.
9 weeks
3 hours per week
100% Online
Certified Learning
Download the brochure
Course Overview
Pre-trained language models offer remarkable capabilities, but real-world applications often demand tailored solutions within complex workflows. This module explores advanced engineering techniques to customise and integrate large language models into sophisticated systems.
You will begin by integrating APIs and managing dynamic conversation states using both commercial and open-source models. The module examines methods for maintaining context in multi-turn interactions, including short-term and long-term memory types. You will learn task decomposition, iterative prompting, and recursive query generation to guide models in delivering accurate, contextually relevant responses. You will develop agents using frameworks like LangChain and LlamaIndex, integrating custom tools and implementing human-in-the-middle workflows. Additionally, you will delve into multi-modal integration, working with models that process text, images, and audio.
Mastering these techniques equips you to build robust, contextually aware AI systems for complex, real-world applications. You will address critical concerns like data privacy and bias, implement secure database integrations, and perform advanced fine-tuning methods. This expertise positions you at the forefront of AI development, ready to engineer sophisticated solutions that meet the evolving demands of modern industries.
WHAT YOU WILL LEARN
Through the following 9 chapters you will master the fundamental topics essential to the domain of GenAI Agent Engineering.
COURSE TOPICS
-
1 - LLM Integration Techniques
Master the integration of Large Language Models into your applications to unlock the potential of AI in processing and generating human language. Understand why seamless integration is crucial for developing intelligent systems that interact naturally with users. By effectively connecting LLMs with your software, you lay the groundwork for advanced functionalities, enabling your applications to leverage state-of-the-art language capabilities and setting the stage for more complex AI workflows.
-
2 - Managing Conversation Context
Learn to manage conversation context effectively to maintain natural and coherent interactions with users over multiple turns. Discover why handling conversation state is vital for creating applications that remember prior exchanges and provide contextually relevant responses. By mastering techniques for tracking and utilising conversation history, you enhance user experience and enable your systems to engage in more meaningful, human-like dialogues.
-
3 - Advanced Prompt Engineering
Explore advanced prompting techniques to guide LLMs in generating accurate and relevant responses. Understand why crafting effective prompts is essential for eliciting desired behaviours from language models. By mastering task decomposition, iterative prompting, and recursive query generation, you can better control LLM outputs, ensuring your applications provide valuable and context-appropriate information to users.
-
4 - Developing LLM Agents
Delve into building intelligent agents that leverage LLMs for autonomous task handling. Learn why agent development is key to creating systems that can perform complex tasks without constant human guidance. By integrating frameworks like LangChain and LlamaIndex, you enable your applications to use custom tools, manage sub-tasks, and intelligently determine when to involve human intervention, enhancing efficiency and functionality.
-
5 - Incorporating Human Oversight
Understand the importance of integrating human oversight into LLM-driven workflows to ensure accuracy and reliability. Explore why incorporating strategies for human validation and feedback enhances your applications' performance. By designing Human-in-the-Middle workflows, you balance automation with human expertise, addressing critical concerns like data privacy and bias while improving the overall quality of your AI systems.
-
6 - Multi-Modal LLM Integration
Expand your applications' capabilities by integrating multi-modal LLMs that process text, images, and audio. Discover why leveraging models like CLIP and GPT-4 enriches user interactions and enables more comprehensive data analysis. By incorporating multi-modal inputs, you create versatile AI systems that can interpret and respond to a variety of information sources, meeting diverse user needs.
-
7 - Semantic Retrieval and Embeddings
Master semantic retrieval techniques to enable your applications to understand and process large volumes of data effectively. Learn why using embeddings and vector storage is crucial for capturing semantic similarity and enhancing information retrieval. By comparing embedding models and exploring vector stores like FAISS, Chroma, and Pinecone, you equip your systems to provide accurate and relevant responses based on extensive datasets.
-
8 - Secure Data Integration
Prioritise data security and privacy when integrating LLMs with databases. Understand why managing data flow securely is essential for protecting sensitive information. By employing techniques such as Reversible Anonymisation, Data Masking, and Tokenisation, you ensure that your applications handle data responsibly, maintaining user trust and complying with legal and ethical standards.
-
9 - Fine-Tuning and Deployment
Develop expertise in fine-tuning LLMs to customise their behaviour for specific applications. Learn why fine-tuning methods like instruction tuning, SFT, LoRa, and PEFT are vital for optimising model performance. By mastering frameworks like Hugging Face and NVIDIA's NeMo, and understanding distributed fine-tuning techniques, you prepare to scale and deploy AI solutions that are tailored to your needs.
Master the integration of Large Language Models into your applications to unlock the potential of AI in processing and generating human language. Understand why seamless integration is crucial for developing intelligent systems that interact naturally with users. By effectively connecting LLMs with your software, you lay the groundwork for advanced functionalities, enabling your applications to leverage state-of-the-art language capabilities and setting the stage for more complex AI workflows.
WHY LONDON SCHOOL OF INNOVATION ?
Specialist: Tech and Innovation
As the UK's only higher-ed institution dedicated to tech, innovation and entrepreneurship, LSI optimises your path to mastery and confidence.
While many universities try to be everything to everyone, LSI stands focused.
From curriculum design to teaching systems, faculty and culture, every fibre of our being is devoted to one goal: empowering you to be a well-rounded leader of our AI-augmented tomorrow.
AI-Powered Teaching
Our pioneering AI platform redefines education, with a virtual private tutor leading you through a personalised, hands-on learning experience.
Our proprietary tech emulates a 24/7 supportive, friendly, and emotionally intelligent virtual human, offering a multi-media experience with interactive audio-visual feedback. It offers formative assessments, critiques your work, and communicates effectively.
This unprecedented technology is at the heart of the LSI offering, creating optimal learning paths for each student, identifying skill gaps, and driving their development to perfection.
Uniquely Human: Personal Support
Instead of lectures, our pedagogy thrives on routine one-to-one sessions, because nothing can inspire quite like an authentic human connection.
Higher education is as much an emotional journey as it is an intellectual one.
LSI's frequent one-to-one sessions provide a safe space for personal growth, offering pastoral and academic support tailored to each student. They help you navigate the challenges of life, work, and academic complexities to realise your aspirations.
Real Skills: Beyond Theory
Our courses go beyond theory and emphasise practical applications. Students are guided to apply knowledge and skills in realistic scenarios, providing them with knowhow directly applicable to their careers.
Our state-of-the-art and AI-powered teaching technology provides instant feedback on practical assignments, which is subsequently supported by expert human review and feedback.
This approach brings the best of real-time and asynchronous learning to foster a smooth and motivating learning flow, leading to development of essential skills and memorable educational experiences.
Flexible Learning
Flexible education is in LSI's DNA. Our online learning caters to each student's pace and style. Attend live sessions in-person or remotely, or learn independently anytime, anywhere, using a laptop or smartphone.
Our technology supports multiple formats, presenting content as text, images, video, and audio, so you can choose what works best for you.
Additionally, collaborative learning is enhanced by AI-augmented discussion forums, combining human and artificial intelligence. This integrated platform offers the best of both worlds for a seamless learning experience.
Professional Networking
LSI fosters tomorrow's industry leaders. Your peers will be invaluable connections to have, not only for direct support and professional growth but also for enriching future collaborations.
At LSI, you’ll immerse yourself in a dynamic community of ambitious and innovative minds. These connections extend beyond the classroom. They can not only inspire you but also open doors, offering a continuous source of support and opportunity throughout your career.
This will not be limited to just your cohort, but our entire LSI Alumni Network, through our exclusive networking events.
Virtual
private tutor
Experience the future of education today with our state-of-the-art AI-based teaching technology. No, it's not just an AI chatbot. It is your virtual tutor, guiding you through a personalised journey of hands-on learning.
Master
the theory with AI
Experience a learning journey tailored just for you. With AI, every lesson is customised to fit your pace and needs, making your education uniquely yours.
Instant feedback
for assignments
Benefit from real-time AI feedback on your submitted assignments while you wait for teachers' review. Our cutting-edge AI technology provides instant insights, helping you track your progress and focus on areas for improvement, ensuring continuous growth.
Role-Play
with AI
Immerse yourself in lifelike scenarios powered by AI, with role-play exercises that put you in dynamic situations, allowing you to practice and hone your skills. Engage in realistic interactions that challenge your decision-making abilities, preparing you for real-world applications. This experiential learning approach ensures you build confidence and expertise in a safe, controlled environment.
Showcase Your Skills
Upon successfully completing this course, your digital certificate will be issued for adding to your CV and LinkedIn profile.
As a registered UK Higher Education Provider regulated by the OfS (Office for Students), LSI certificates will be internationally recognised and respected by employers worldwide.
Your certificate will come with a unique URL for verification, making it a credible and authentic proof of your learning and achievement.
Supercharge Your Career
Raise your game, boost your confidence and safeguard your relevance
LSI Lifelong Learning*
Always stay up-to-date
Smart monthly refresher content notifications for alumni.
Keep abreast of the developments in the field of data.
Reinvent Yourself to Ace the Age of Al
Get on the right side of the technological revolution and secure a prosperous future.
Exclusive LSI Resources
Permanent @lsi.ac.uk email forwarding address.
30% discount on eligible LSI courses.
Networking and Events
Always stay up-to-date
Join alumni clubs, networking and education events.
Attend the annual LSI Alumni Conference.
CHOOSE YOUR MODE OF STUDY
SELF-PACED
£1450
plus VAT9-week flexible programme
Learn at your own pace
100% flexibility (no fixed weekly schedule)
Start anytime
Select