AI Gateway
Every model call goes through one gateway. It records latency, token usage, and cost (from the registry list prices), and falls back to the alternate provider on errors. The 50 most recent calls:
| Time | Model | Kind | Route | Tokens in/out | Latency | Cost |
|---|---|---|---|---|---|---|
| 25 Jul 2026, 5:37:32 am | Claude Haiku 4.5 | stream | pii-sensitive | 1,920 / 345 | 5,065 ms | $0.0036 |
| 25 Jul 2026, 5:37:19 am | Claude Haiku 4.5 | stream | pii-sensitive | 1,742 / 99 | 1,327 ms | $0.0022 |
| 21 Jul 2026, 1:26:46 pm | Claude Sonnet 4.6 | stream | grounded-citation | 1,725 / 65 | 2,637 ms | $0.0062 |
| 21 Jul 2026, 1:26:18 pm | GPT-4o mini | stream | general casework | 1,453 / 20 | 1,603 ms | $0.0002 |
| 21 Jul 2026, 1:26:09 pm | Claude Sonnet 4.6 | stream | grounded-citation | 2,372 / 132 | 3,641 ms | $0.0091 |
| 21 Jul 2026, 1:26:03 pm | Claude Sonnet 4.6 | stream | grounded-citation | 1,708 / 99 | 3,032 ms | $0.0066 |
| 21 Jul 2026, 1:08:54 pm | Claude Sonnet 4.6 | stream | grounded-citation | 3,111 / 152 | 4,726 ms | $0.0116 |
| 21 Jul 2026, 1:08:49 pm | Claude Sonnet 4.6 | stream | grounded-citation | 1,931 / 114 | 2,635 ms | $0.0075 |
| 21 Jul 2026, 1:08:41 pm | GPT-4o mini | stream | general casework | 779 / 199 | 4,422 ms | $0.0002 |
| 21 Jul 2026, 9:14:14 am | Claude Haiku 4.5 | stream | pii-sensitive | 2,857 / 392 | 6,446 ms | $0.0048 |
| 21 Jul 2026, 9:14:07 am | Claude Haiku 4.5 | stream | pii-sensitive | 1,742 / 99 | 2,139 ms | $0.0022 |
| 21 Jul 2026, 9:12:51 am | GPT-4.1 | stream | calculation | 1,402 / 273 | 2,955 ms | $0.0050 |
| 21 Jul 2026, 9:12:43 am | GPT-4.1 | stream | calculation | 826 / 98 | 3,296 ms | $0.0024 |
| 17 Jul 2026, 4:58:19 pm | GPT-4o mini | stream | general casework | 783 / 253 | 4,287 ms | $0.0003 |
| 17 Jul 2026, 4:23:21 pm | GPT-4o mini | stream | general casework | 783 / 271 | 11,230 ms | $0.0003 |
| 17 Jul 2026, 4:19:14 pm | Claude Haiku 4.5 | stream | pii-sensitive | 1,700 / 160 | 3,781 ms | $0.0025 |
| 17 Jul 2026, 4:07:20 pm | Claude Opus 4.8 | stream | complex-reasoning | 2,728 / 278 | 5,544 ms | $0.0618 |
| 17 Jul 2026, 4:07:12 pm | Claude Opus 4.8 | stream | complex-reasoning | 1,921 / 150 | 3,906 ms | $0.0401 |
| 17 Jul 2026, 4:03:18 pm | GPT-4.1 | stream | calculation | 880 / 105 | 2,245 ms | $0.0026 |
| 17 Jul 2026, 4:03:14 pm | GPT-4.1 | stream | calculation | 800 / 56 | 2,801 ms | $0.0020 |
| 17 Jul 2026, 1:08:40 pm | Claude Haiku 4.5 | stream | pii-sensitive | 1,700 / 154 | 2,712 ms | $0.0025 |
| 17 Jul 2026, 12:56:57 pm | Claude Opus 4.8 | stream | complex-reasoning | 2,800 / 395 | 10,609 ms | $0.0716 |
| 17 Jul 2026, 12:56:45 pm | Claude Opus 4.8 | stream | complex-reasoning | 1,921 / 222 | 7,637 ms | $0.0455 |
| 17 Jul 2026, 12:52:45 pm | GPT-4.1 | stream | calculation | 1,297 / 114 | 2,225 ms | $0.0035 |
| 17 Jul 2026, 12:52:39 pm | GPT-4.1 | stream | calculation | 800 / 56 | 2,805 ms | $0.0020 |
| 17 Jul 2026, 12:44:52 pm | GPT-4o mini | stream | general casework | 783 / 285 | 5,620 ms | $0.0003 |
| 17 Jul 2026, 10:32:41 am | Claude Opus 4.8 | stream | complex-reasoning | 2,126 / 280 | 5,876 ms | $0.0529 |
| 17 Jul 2026, 10:32:32 am | Claude Opus 4.8 | stream | complex-reasoning | 1,921 / 184 | 3,908 ms | $0.0426 |
| 17 Jul 2026, 7:46:56 am | Claude Opus 4.8 | stream | complex-reasoning | 2,773 / 359 | 9,623 ms | $0.0685 |
| 17 Jul 2026, 7:46:44 am | Claude Opus 4.8 | stream | complex-reasoning | 1,921 / 195 | 4,114 ms | $0.0434 |
| 17 Jul 2026, 7:42:46 am | GPT-4o mini | stream | general casework | 783 / 274 | 6,860 ms | $0.0003 |
| 17 Jul 2026, 7:38:43 am | Claude Haiku 4.5 | stream | pii-sensitive | 1,700 / 161 | 2,745 ms | $0.0025 |
| 17 Jul 2026, 7:22:50 am | GPT-4.1 | stream | calculation | 1,297 / 117 | 2,554 ms | $0.0035 |
| 17 Jul 2026, 7:22:45 am | GPT-4.1 | stream | calculation | 800 / 56 | 2,905 ms | $0.0020 |
| 17 Jul 2026, 1:59:15 am | Claude Opus 4.8 | stream | complex-reasoning | 2,016 / 443 | 8,378 ms | $0.0635 |
| 17 Jul 2026, 1:59:05 am | Claude Opus 4.8 | stream | complex-reasoning | 1,921 / 74 | 3,921 ms | $0.0344 |
| 17 Jul 2026, 1:55:10 am | GPT-4.1 | stream | calculation | 1,297 / 125 | 2,346 ms | $0.0036 |
| 17 Jul 2026, 1:55:01 am | GPT-4.1 | stream | calculation | 800 / 56 | 2,303 ms | $0.0020 |
| 17 Jul 2026, 1:51:08 am | GPT-4o mini | stream | general casework | 783 / 255 | 9,978 ms | $0.0003 |
| 17 Jul 2026, 1:47:01 am | Claude Haiku 4.5 | stream | pii-sensitive | 1,700 / 175 | 3,118 ms | $0.0026 |
| 3 Jul 2026, 3:00:21 pm | Claude Sonnet 4.6 | stream | grounded-citation | 2,068 / 134 | 3,273 ms | $0.0082 |
| 3 Jul 2026, 3:00:15 pm | Claude Sonnet 4.6 | stream | grounded-citation | 1,404 / 99 | 2,462 ms | $0.0057 |
| 3 Jul 2026, 10:30:30 am | Claude Haiku 4.5 | generate | judge | 857 / 97 | 2,034 ms | $0.0013 |
| 3 Jul 2026, 10:30:27 am | Claude Opus 4.8 | generate | eval | 2,733 / 689 | 9,728 ms | $0.0927 |
| 3 Jul 2026, 10:30:23 am | Claude Haiku 4.5 | generate | judge | 490 / 84 | 1,889 ms | $0.0009 |
| 3 Jul 2026, 10:30:21 am | Claude Sonnet 4.6 | generate | eval | 1,772 / 146 | 4,536 ms | $0.0075 |
| 3 Jul 2026, 10:30:20 am | Claude Haiku 4.5 | generate | judge | 367 / 102 | 2,035 ms | $0.0009 |
| 3 Jul 2026, 10:30:20 am | Claude Haiku 4.5 | generate | judge | 551 / 108 | 2,331 ms | $0.0011 |
| 3 Jul 2026, 10:30:18 am | GPT-4o mini | generate | eval | 1,093 / 33 | 1,989 ms | $0.0002 |
| 3 Jul 2026, 10:30:17 am | Claude Haiku 4.5 | generate | eval | 1,280 / 198 | 2,960 ms | $0.0023 |