Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Duration 7 hours
Course Outline
Transitioning from Text Generation to Typed Decisions
- Understanding the nature of decision model outputs.
- Contrasting System one decisions with reasoning LLMs.
- Examining the cost and latency profiles of bounded decisions.
The Open-Weight Decision Model Ecosystem
- Strands Decider 2B developed by AWS Labs.
- The JEV and GEV open-weight model families.
- Other notable models including Pplx-Decider, Liquid D1, and Clef.
- Key differences in licensing and deployment strategies.
Architecture of a Decision Model
- The LLM torso utilized without a standard language modelling head.
- The pointer head mechanism for scoring candidate options.
- The source and derivation of confidence scores.
Executing Your First Decisions
- Setting up the model locally on CPUs or consumer-grade GPUs.
- Structuring questions and defining option sets effectively.
- Processing multiple questions in a single inference pass.
- Configuring thresholds and managing fallback behavior.
Evaluating Decision Quality
- Overview of JevBench and other decision-specific benchmarks.
- Balancing accuracy against calibration.
- Understanding the Brier score and the reliability of confidence levels.
- Recognizing tasks where a decision model is an inappropriate solution.
Requirements
- A basic understanding of large language models and prompt-based applications.
- Proficiency with the command line and Python scripting.
- No prior experience in machine learning training is necessary.
Target Audience
- AI engineers assessing decision models for agent workflows.
- Software developers looking to replace broad LLM calls with bounded, specific decisions.
- Solution and platform architects designing agent-centric architectures.
- Technical product managers evaluating decision model capabilities.
Custom Corporate Training
Training solutions designed exclusively for businesses.
- Customized Content: We adapt the syllabus and practical exercises to the real goals and needs of your project.
- Flexible Schedule: Dates and times adapted to your team's agenda.
- Format: Online (live), In-company (at your offices), or Hybrid.
Price per private group, online live training, starting from 1600 € + VAT*
Contact us for an exact quote and to hear our latest promotions
