Weights & Biases - Comparing Runs between projects in W&B
The video provides a step-by-step guide on comparing runs from two different projects. It begins by creating a new report for the first project, 'compare runs one,' and then adds a run set from the second project, 'compare runs two.' The process involves visualizing both runs side by side for comparison. A practical tip offered is changing the color of the runs to differentiate them easily, as both runs initially appear in blue. This visual distinction aids in better analysis and comparison of the test metrics from each project.
Key Points:
- Create a new report for the first project.
- Add a run set from the second project for comparison.
- Visualize both runs side by side.
- Change the color of runs for easier comparison.
- Ensure both projects have the same test metric for valid comparison.
Details:
1. 🎥 Introduction to Comparing Project Runs
- Two projects, 'Compare Runs 1' and 'Compare Runs 2', are demonstrated to show the process of comparison between project runs.
- Project 1 includes a run named 'Visionary George 1', while Project 2 includes a run named 'Smooth Clout 1'.
- Both projects are evaluated using a test metric to facilitate meaningful comparison.
- The comparison focuses on highlighting differences and similarities in performance between the two runs.
2. 📝 Creating a New Report
- Begin by creating a new report from computer runs to organize and analyze your data efficiently.
- Enhance report visibility by increasing its size, ensuring all data is easily readable.
- Utilize the 'Run set' feature for better organization: click the plus button to add a new run set, allowing for structured data comparison.