Performance results of AI coding models on LanceDB tasks, measuring success rate and execution time with high precision.
| Model | Passed | Avg Duration | Success Rate |
|---|---|---|---|
| #1 gemini-3.5-flashNEW | 9 | 285.4s | 90% |
| #2 claude-4-6-sonnet | 8 | 162.4s | 80% |
| #3 glm-5.1 | 7 | 287.1s | 70% |
| #4 gemini-3-flash | 7 | 129.6s | 70% |
| #5 gemini-3.1-pro | 6 | 153.4s | 60% |