Tiktoken.Core 2.2.0
The fastest tokenizer for GPT-3.5 and GPT-4 inspired by Tiktoken.
No packages depend on Tiktoken.Core.
.NET Framework 4.6.2
- Tiktoken.Encodings.Abstractions (>= 2.2.0)
- System.ValueTuple (>= 4.5.0)
.NET 8.0
- Tiktoken.Encodings.Abstractions (>= 2.2.0)
.NET 9.0
- Tiktoken.Encodings.Abstractions (>= 2.2.0)
.NET Standard 2.0
- Tiktoken.Encodings.Abstractions (>= 2.2.0)
.NET Standard 2.1
- Tiktoken.Encodings.Abstractions (>= 2.2.0)