Commit Graph

375 Commits

Author SHA1 Message Date
Laisky.Cai
a0ea7268fe fix: update StreamHandler to support cross-region model IDs for AWS 2025-03-12 00:34:09 +00:00
Laisky.Cai
c483cf5b49 chore: update Dockerfile and dependencies; bump Go version and AWS SDK packages 2025-03-10 06:59:21 +00:00
Laisky.Cai
5296a588b1 feat: add support for aws's cross region inferences
closes #2024, closes #2145
2025-03-10 06:37:42 +00:00
Laisky.Cai
388f0ef6aa docs: update README for clarity and fix translation issues; improve token update descriptions 2025-03-09 12:50:52 +00:00
Laisky.Cai
13f49fa4b9 feat: add JSON serialization and update completion ratio handling with mutex synchronization 2025-03-03 05:37:38 +00:00
Laisky.Cai
fc828e407b feat: add support for gpt-4.5-preview model and update billing ratios 2025-03-03 03:52:09 +00:00
Laisky.Cai
f5d4ff05dc Merge branch 'test/ci' 2025-02-26 05:40:36 +00:00
Laisky.Cai
1bc83bf812 chore: enhance Anthropic support and optimize CI/CD processes
- Enhance the `Message` struct with new fields to support additional functionality.
- Streamline CI configuration by commenting out unused jobs and optimizing the build process for ARM64.
- Improve documentation and feature support for VolcEngine channel and bot model.
- Update Dockerfile to efficiently manage dependencies and enhance multi-architecture support.
2025-02-26 05:39:08 +00:00
Laisky.Cai
f6cfe7cd4f feat: enhance error handling and reasoning mechanisms across middleware
- Improve error handling across multiple middleware and adapter components, ensuring consistent error response formats in JSON.
- Enhance the functionality of request conversion functions by including context parameters and robust error wrapping.
- Introduce new features related to reasoning content in the messaging model, providing better customization and explanations in the documentation.
2025-02-26 05:38:21 +00:00
Laisky.Cai
07d9a8e144
Merge pull request #30 from qistchan/fix-2109
Fix 2109
2025-02-26 09:02:24 +08:00
Laisky.Cai
8d3a6b5cb9 feat: ensure TopP is nil when using extended thinking in Claude request 2025-02-25 03:56:07 +00:00
Laisky.Cai
f60300e52c feat: update README and enhance response handling for Claude model to support reasoning and thinking 2025-02-25 03:13:21 +00:00
Laisky.Cai
f7ec449728 feat: add support for extended reasoning in Claude 3.7 model 2025-02-25 02:57:37 +00:00
Laisky.Cai
9b56485857 feat: update model list and pricing for Claude 3.7 versions 2025-02-25 01:27:07 +00:00
Laisky.Cai
c2a0318e7b
Merge pull request #29 from qistchan/fix-#1982
fix: resolve "bufio.Scanner: token too long" error by increasing buff…
2025-02-25 09:21:39 +08:00
QistChan
e71893df6e feat: Enhance VolcEngine channel support with bot model routing 2025-02-24 01:46:47 +00:00
QistChan
1ac79a8126 fix: Improve OpenAI stream data parsing 2025-02-24 01:45:24 +00:00
QistChan
706aa7233b
fix: resolve "bufio.Scanner: token too long" error by increasing buffer size 2025-02-24 01:59:54 +08:00
Laisky.Cai
647718f3e6 feat: add OpenrouterProviderSort configuration for provider sorting 2025-02-20 01:51:19 +00:00
Laisky.Cai
04da1b7861 fix: improve reasoning token counting in OpenAI adaptor 2025-02-19 09:13:17 +00:00
Laisky.Cai
8c77218480 feat: update billing ratios for DeepSeek models 2025-02-19 08:47:09 +00:00
Laisky.Cai
a45a3d6241 feat: enhance reasoning token handling in OpenAI adaptor 2025-02-19 08:10:04 +00:00
Laisky.Cai
abe6afacca Merge branch 'fix/openrouter-reasoning' 2025-02-19 01:32:51 +00:00
Laisky.Cai
480f248a3d feat: support OpenRouter reasoning 2025-02-19 01:20:14 +00:00
Laisky.Cai
a5f5e85c44 feat: support OpenRouter reasoning 2025-02-19 01:11:46 +00:00
Laisky.Cai
2a5908586d Merge branch 'upstream/main' 2025-02-16 13:18:50 +00:00
longkeyy
7ac553541b
feat: update openrouter models and price 20250213 (#2084)
Some checks failed
CI / Unit tests (push) Has been cancelled
CI / commit_lint (push) Has been cancelled
2025-02-16 18:01:59 +08:00
longkeyy
a5c517c27a
feat: update ali models and price 20250213 (#2086) 2025-02-16 18:01:24 +08:00
JustSong
3f421c4f04 feat: support Gemini openai compatible api 2025-02-16 17:59:39 +08:00
JustSong
cafd0a0327 feat: add OpenAI compatible channel (close #2091) 2025-02-16 17:38:06 +08:00
Laisky.Cai
fef7ae048b
feat: support gemini-2.0-flash (#2055)
* feat: support gemini-2.0-flash

- Enhance model support by adding new entries and refining checks for system instruction compatibility.
- Update logging display behavior and adjust default quotas for better user experience.
- Revamp pricing structures in the billing system to reflect current model values and deprecate outdated entries.
- Streamline code by replacing hardcoded values with configurations for maintainability.

* feat: add new Gemini 2.0 flash models to adapter and billing ratio

* fix: update GetRequestURL to support gemini-1.5 model in versioning
2025-02-12 00:34:25 +08:00
JustSong
53da209134 feat: add AliBailian adaptor and update channel options 2025-02-12 00:15:43 +08:00
JustSong
eb96aa635e feat: update OpenRouter channel name and add model list for OpenRouter adaptor 2025-02-11 00:20:55 +08:00
Laisky.Cai
33f3400c12 fix: update Prompt type in GeneralOpenAIRequest and adjust related logic in ConvertCompletionsRequest 2025-02-10 02:11:53 +00:00
JustSong
c715f2bc1d feat: add new models for xai
Some checks are pending
CI / Unit tests (push) Waiting to run
CI / commit_lint (push) Waiting to run
2025-02-09 21:21:28 +08:00
JustSong
696265774e feat: add MiniMax model constants to the adaptor 2025-02-09 18:55:32 +08:00
JustSong
974729426d feat: refactor Xunfei API version handling and update model list 2025-02-09 18:50:51 +08:00
JustSong
57c1367ec8 feat: add Xunfei V2 channel support and update related configurations 2025-02-09 18:31:54 +08:00
JustSong
44233d5c04 feat: add completion tokens details and reasoning effort fields to model (close #2050) 2025-02-09 18:14:01 +08:00
JustSong
bf45a955c3 fix: update system prompt handling by renaming field and ensuring proper usage in request processing (close #2069) 2025-02-09 14:41:42 +08:00
JustSong
dd65b997dd feat: add Baidu V2 channel support and improve model handling 2025-02-09 12:37:26 +08:00
Laisky.Cai
4fb8501833 Merge branch 'upstream/main' 2025-02-09 03:49:59 +00:00
longkeyy
3e3b8230ac
fix: add read/write locks for ModelRatio and GroupRatio to prevent concurrent map read/write issues (#2067)
Some checks are pending
CI / Unit tests (push) Waiting to run
CI / commit_lint (push) Waiting to run
2025-02-09 11:02:45 +08:00
JustSong
07808122a6 fix: fix Debugf not using DebugEnabled (close #2068) 2025-02-09 10:57:22 +08:00
Laisky.Cai
032f9892c8 Merge branch 'upstream/main' 2025-02-07 02:36:12 +00:00
Laisky.Cai
2ab5f8ab47 fix: update GetRequestURL to support gemini-1.5 model in versioning 2025-02-07 02:31:22 +00:00
Laisky.Cai
6ac92a008b feat: update API version handling for Azure channel in Adaptor 2025-02-07 01:36:25 +00:00
JustSong
293ba93ad6 fix: remove outdated model from ModelList and add new deepseek models 2025-02-07 00:13:57 +08:00
JustSong
e146b14d46 fix: add default API version handling and enhance error message checks for Gemini 2025-02-07 00:01:38 +08:00
JustSong
e19045f925 chore: add deepseek-reasoner 2025-02-06 23:38:29 +08:00