GenAI Agent Engineering
Develop advanced AI systems by mastering the intricacies of customisation and integration. This module provides the skills to create complex, multi-step interaction workflows using commercial and open-source models. Explore dynamic conversation state management, agent development, multi-modal integration, secure database connections, and advanced fine-tuning methods. Build robust, contextually aware AI solutions tailored for real-world applications.
Course Overview
Pre-trained language models offer remarkable capabilities, but real-world applications often demand tailored solutions within complex workflows. This module explores advanced engineering techniques to customise and integrate large language models into sophisticated systems.
You will begin by integrating APIs and managing dynamic conversation states using both commercial and open-source models. The module examines methods for maintaining context in multi-turn interactions, including short-term and long-term memory types. You will learn task decomposition, iterative prompting, and recursive query generation to guide models in delivering accurate, contextually relevant responses. You will develop agents using frameworks like LangChain and LlamaIndex, integrating custom tools and implementing human-in-the-middle workflows. Additionally, you will delve into multi-modal integration, working with models that process text, images, and audio.
Mastering these techniques equips you to build robust, contextually aware AI systems for complex, real-world applications. You will address critical concerns like data privacy and bias, implement secure database integrations, and perform advanced fine-tuning methods. This expertise positions you at the forefront of AI development, ready to engineer sophisticated solutions that meet the evolving demands of modern industries.
Who is this course for?
What you will learn
Through the following 8 chapters you will master the fundamental topics essential to the domain of AI in Public Service: Opportunities, Challenges and Ethics.
Course topics
Master the integration of Large Language Models into your applications to unlock the potential of AI in processing and generating human language. Understand why seamless integration is crucial for developing intelligent systems that interact naturally with users. By effectively connecting LLMs with your software, you lay the groundwork for advanced functionalities, enabling your applications to leverage state-of-the-art language capabilities and setting the stage for more complex AI workflows.
Full module specification
|
Learn to manage conversation context effectively to maintain natural and coherent interactions with users over multiple turns. Discover why handling conversation state is vital for creating applications that remember prior exchanges and provide contextually relevant responses. By mastering techniques for tracking and utilising conversation history, you enhance user experience and enable your systems to engage in more meaningful, human-like dialogues.
Full module specification
|
Explore advanced prompting techniques to guide LLMs in generating accurate and relevant responses. Understand why crafting effective prompts is essential for eliciting desired behaviours from language models. By mastering task decomposition, iterative prompting, and recursive query generation, you can better control LLM outputs, ensuring your applications provide valuable and context-appropriate information to users.
Full module specification
|
Delve into building intelligent agents that leverage LLMs for autonomous task handling. Learn why agent development is key to creating systems that can perform complex tasks without constant human guidance. By integrating frameworks like LangChain and LlamaIndex, you enable your applications to use custom tools, manage sub-tasks, and intelligently determine when to involve human intervention, enhancing efficiency and functionality.
Full module specification
|
Understand the importance of integrating human oversight into LLM-driven workflows to ensure accuracy and reliability. Explore why incorporating strategies for human validation and feedback enhances your applications' performance. By designing Human-in-the-Middle workflows, you balance automation with human expertise, addressing critical concerns like data privacy and bias while improving the overall quality of your AI systems.
Full module specification
|
Expand your applications' capabilities by integrating multi-modal LLMs that process text, images, and audio. Discover why leveraging models like CLIP and GPT-4 enriches user interactions and enables more comprehensive data analysis. By incorporating multi-modal inputs, you create versatile AI systems that can interpret and respond to a variety of information sources, meeting diverse user needs.
Full module specification
|
Master semantic retrieval techniques to enable your applications to understand and process large volumes of data effectively. Learn why using embeddings and vector storage is crucial for capturing semantic similarity and enhancing information retrieval. By comparing embedding models and exploring vector stores like FAISS, Chroma, and Pinecone, you equip your systems to provide accurate and relevant responses based on extensive datasets.
Full module specification
|
Prioritise data security and privacy when integrating LLMs with databases. Understand why managing data flow securely is essential for protecting sensitive information. By employing techniques such as Reversible Anonymisation, Data Masking, and Tokenisation, you ensure that your applications handle data responsibly, maintaining user trust and complying with legal and ethical standards.
Full module specification
|
Develop expertise in fine-tuning LLMs to customise their behaviour for specific applications. Learn why fine-tuning methods like instruction tuning, SFT, LoRa, and PEFT are vital for optimising model performance. By mastering frameworks like Hugging Face and NVIDIA's NeMo, and understanding distributed fine-tuning techniques, you prepare to scale and deploy AI solutions that are tailored to your needs.
Full module specification
|
Why LSI
At LSI, we redefine higher education to meet the demands of a rapidly evolving world. Rooted in technology, innovation, and entrepreneurship, our approach is designed to empower individuals to thrive in an AI-driven future. From cutting-edge learning systems to a deeply supportive community, every aspect of LSI is crafted to inspire, challenge, and elevate your potential.
Specialist in
|
AI-enhanced
|
Community of
|
Uniquely human
|
Your learning journey enhanced with AI
A learning experience like no other, where cutting-edge AI transforms education into a personalised journey of discovery. At the London School of Innovation, we combine innovative technology with forward-thinking teaching to prepare you for an AI-powered future.
Virtual
private tutor
Experience the future of education today with our state-of-the-art AI-based teaching technology. No, it's not just an AI chatbot. It is your virtual tutor, guiding you through a personalised journey of hands-on learning.
Master
the theory with AI
Experience a learning journey tailored just for you. With AI, every lesson is customised to fit your pace and needs, making your education uniquely yours.
Instant feedback
for assignments
Benefit from real-time AI feedback on your submitted assignments while you wait for teachers' review. Our cutting-edge AI technology provides instant insights, helping you track your progress and focus on areas for improvement, ensuring continuous growth.
Role-Play
with AI
Immerse yourself in lifelike scenarios powered by AI, with role-play exercises that put you in dynamic situations, allowing you to practice and hone your skills. Engage in realistic interactions that challenge your decision-making abilities, preparing you for real-world applications. This experiential learning approach ensures you build confidence and expertise in a safe, controlled environment.
FAQs
View all courses