Developing DSPy Metrics & Debugging DSPy Programs | Debugging with Phoenix Server
Description.
DSPy programs can be complex, and go for multiple hops. Even after careful preparation, there could be some issues that might slip through. Tracing the LLM calls can be very challenging with logging, and DSPy traces are only present when the examples are bootstrapped.
In this video, lets briefly dive into the process of debugging the DSPy metrics and programs using the Phoenix server.
Chapter Navigation:
0:00 Intro
0:20 Agenda
1:20 Metric Primer
2:20 Parts of Metric
3:55 Metric During Optimisation
5:30 Looking at DSPy Trace
6:10 Metric During Evaluation
7:40 Debugging with Phoenix server
10:15 Reviewing Bootstrapped calls
11:45 Reviewing
12:20 Outro
The code for supporting notebook is present in the below git repo
https://github.com/insightbuilder/cod...
PS: Got a question or have a feedback on my content. Get in touch
By leaving a Comment in the video
Want to Consult? Feel free to book a short call with me.
https://cal.com/insight-kamalraj
Buy me a Coffee
https://ko-fi.com/insightbuilder
@mail [email protected]
@github https://github.com/Kamalabot
Watch video Developing DSPy Metrics & Debugging DSPy Programs | Debugging with Phoenix Server online without registration, duration hours minute second in high quality. This video was added by user Kamalraj M M 24 August 2024, don't forget to share it with your friends and acquaintances, it has been viewed on our site 95 once and liked it 2 people.