Commit Graph

403 Commits

Author SHA1 Message Date
Laisky.Cai
8f50f485a9 fix: update ImageUsdPerPic calculation to use QuotaPerUsd for accurate billing 2025-03-16 14:34:50 +00:00
Laisky.Cai
c9bc075b04 Merge branch 'feature/imagen3' 2025-03-16 14:21:45 +00:00
Laisky.Cai
580fec6359 feat: implement image editing request handling and response conversion for Imagen API 2025-03-16 14:21:38 +00:00
Laisky.Cai
ff963e819f feat: update image model ratios and adjust quota calculations for billing 2025-03-16 13:07:36 +00:00
Laisky.Cai
4bdc2835bd feat: update model list and add new model ratios for billing calculations 2025-03-16 12:50:06 +00:00
Laisky.Cai
3bf121aae8 fix: add warning log for model ratios below threshold 2025-03-16 07:48:55 +00:00
Laisky.Cai
400ee3aa24 Enhance logging and error handling in processing logic
- Enhance logging by including requested image counts for improved tracking.
- Implement user quota validation before processing image requests.
- Improve error handling for model validation and JSON unmarshalling in billing processes.
2025-03-16 07:47:59 +00:00
Laisky.Cai
fa794e7bd5 feat: update model lists and adjust quota calculation logic
⚠️breaking change warning: for image models, the model ratio represents the quota cost per image
2025-03-16 02:01:44 +00:00
Laisky.Cai
f3300f08e2 fix: update model ratios and add completion ratio calculations 2025-03-14 03:07:58 +00:00
Laisky.Cai
2f32545ab0 Merge branch 'patch/openai-search' 2025-03-13 10:02:22 +00:00
Laisky.Cai
6708eed8a0 fix: refactor cost calculation logic for web-search tools and improve quota handling 2025-03-13 09:52:13 +00:00
Laisky.Cai
ad63c9e66f fix: update cost calculation to use QuotaPerUsd for search context sizes 2025-03-13 09:50:35 +00:00
Laisky.Cai
2f34798aa9 fix: refactor cost calculation logic for web-search tools and improve quota handling 2025-03-13 09:33:03 +00:00
Laisky.Cai
82225818e3 fix: update cost calculation to use QuotaPerUsd for search context sizes 2025-03-13 09:17:59 +00:00
Laisky.Cai
76e8199026 fix: add support for OpenAI web search models in documentation and request handling 2025-03-13 08:23:07 +00:00
Laisky.Cai
bbf6b77411 fix: add support for OpenAI web search models in documentation and request handling 2025-03-13 08:22:04 +00:00
Laisky.Cai
413fcde382 feat: support openai websearch models 2025-03-13 03:46:15 +00:00
Laisky.Cai
eb5e7efdd7 feat: support openai websearch models 2025-03-13 03:37:38 +00:00
Laisky.Cai
a20f57a923 fix: update .gitignore and improve model handling in various adapters and billing ratios
closes #37
2025-03-13 01:47:41 +00:00
Laisky.Cai
6e634b85cf fix: update StreamHandler to support cross-region model IDs for AWS 2025-03-12 00:34:15 +00:00
Laisky.Cai
a0ea7268fe fix: update StreamHandler to support cross-region model IDs for AWS 2025-03-12 00:34:09 +00:00
Laisky.Cai
a0d7d5a965 fix: support thinking for aws claude 2025-03-10 07:00:45 +00:00
Laisky.Cai
c483cf5b49 chore: update Dockerfile and dependencies; bump Go version and AWS SDK packages 2025-03-10 06:59:21 +00:00
Laisky.Cai
de10e102bd feat: add support for aws's cross region inferences
closes #2024, closes #2145
2025-03-10 06:43:40 +00:00
Laisky.Cai
5296a588b1 feat: add support for aws's cross region inferences
closes #2024, closes #2145
2025-03-10 06:37:42 +00:00
Laisky.Cai
388f0ef6aa docs: update README for clarity and fix translation issues; improve token update descriptions 2025-03-09 12:50:52 +00:00
Laisky.Cai
13f49fa4b9 feat: add JSON serialization and update completion ratio handling with mutex synchronization 2025-03-03 05:37:38 +00:00
Laisky.Cai
fc828e407b feat: add support for gpt-4.5-preview model and update billing ratios 2025-03-03 03:52:09 +00:00
Laisky.Cai
f5d4ff05dc Merge branch 'test/ci' 2025-02-26 05:40:36 +00:00
Laisky.Cai
1bc83bf812 chore: enhance Anthropic support and optimize CI/CD processes
- Enhance the `Message` struct with new fields to support additional functionality.
- Streamline CI configuration by commenting out unused jobs and optimizing the build process for ARM64.
- Improve documentation and feature support for VolcEngine channel and bot model.
- Update Dockerfile to efficiently manage dependencies and enhance multi-architecture support.
2025-02-26 05:39:08 +00:00
Laisky.Cai
f6cfe7cd4f feat: enhance error handling and reasoning mechanisms across middleware
- Improve error handling across multiple middleware and adapter components, ensuring consistent error response formats in JSON.
- Enhance the functionality of request conversion functions by including context parameters and robust error wrapping.
- Introduce new features related to reasoning content in the messaging model, providing better customization and explanations in the documentation.
2025-02-26 05:38:21 +00:00
Laisky.Cai
07d9a8e144
Merge pull request #30 from qistchan/fix-2109
Fix 2109
2025-02-26 09:02:24 +08:00
Laisky.Cai
8d3a6b5cb9 feat: ensure TopP is nil when using extended thinking in Claude request 2025-02-25 03:56:07 +00:00
Laisky.Cai
c61d6440f9 fix: claude thinking for non-stream mode 2025-02-25 03:14:18 +00:00
Laisky.Cai
f60300e52c feat: update README and enhance response handling for Claude model to support reasoning and thinking 2025-02-25 03:13:21 +00:00
Laisky.Cai
3a8924d7af feat: add support for extended reasoning in Claude 3.7 model 2025-02-25 03:02:51 +00:00
Laisky.Cai
95527d76ef feat: update model list and pricing for Claude 3.7 versions 2025-02-25 03:02:24 +00:00
Laisky.Cai
f7ec449728 feat: add support for extended reasoning in Claude 3.7 model 2025-02-25 02:57:37 +00:00
Laisky.Cai
9b56485857 feat: update model list and pricing for Claude 3.7 versions 2025-02-25 01:27:07 +00:00
Laisky.Cai
c2a0318e7b
Merge pull request #29 from qistchan/fix-#1982
fix: resolve "bufio.Scanner: token too long" error by increasing buff…
2025-02-25 09:21:39 +08:00
QistChan
e71893df6e feat: Enhance VolcEngine channel support with bot model routing 2025-02-24 01:46:47 +00:00
QistChan
1ac79a8126 fix: Improve OpenAI stream data parsing 2025-02-24 01:45:24 +00:00
QistChan
706aa7233b
fix: resolve "bufio.Scanner: token too long" error by increasing buffer size 2025-02-24 01:59:54 +08:00
Laisky.Cai
7ec33793b7 feat: add OpenrouterProviderSort configuration for provider sorting 2025-02-20 01:51:45 +00:00
Laisky.Cai
647718f3e6 feat: add OpenrouterProviderSort configuration for provider sorting 2025-02-20 01:51:19 +00:00
Laisky.Cai
1a6812182b fix: improve reasoning token counting in OpenAI adaptor 2025-02-19 09:13:24 +00:00
Laisky.Cai
04da1b7861 fix: improve reasoning token counting in OpenAI adaptor 2025-02-19 09:13:17 +00:00
Laisky.Cai
8c77218480 feat: update billing ratios for DeepSeek models 2025-02-19 08:47:09 +00:00
Laisky.Cai
5ba60433d7 feat: enhance reasoning token handling in OpenAI adaptor 2025-02-19 08:10:19 +00:00
Laisky.Cai
a45a3d6241 feat: enhance reasoning token handling in OpenAI adaptor 2025-02-19 08:10:04 +00:00