LLamaSharp

853 Commits

8 Branches

333 MB

322 Download

Tree: bab6b65b61

Commit Graph

Author	SHA1	Message	Date
Yaohui Liu	cb5fb210b1	feat: optimize apis for cuda feature detection.	2 years ago
Martin Evans	a03fe003de	Fixed decoding of text "accumulating" over time (never properly clearing buffer)	2 years ago
Martin Evans	51d4411a58	Added two new classes for detokenization tasks: - `AntipromptProcessor` accepts chunks of text and returns a value indicating if any antiprompt has been detected. - `StreamingTokenDecoder` decodes tokens into text, maintaining some internal state to handle single characters which are encoded as multiple tokens. Added tests for these classes and updated StatelessExecutor to use them. Removed most DeTokenize methods, marked the rest as obsolete (should always use a `StreamingTokenDecoder`).	2 years ago

Author

SHA1

Message

Date

Yaohui Liu

cb5fb210b1

feat: optimize apis for cuda feature detection.

2 years ago

Martin Evans

a03fe003de

Fixed decoding of text "accumulating" over time (never properly clearing buffer)

2 years ago

Martin Evans

51d4411a58

Added two new classes for detokenization tasks:

- `AntipromptProcessor` accepts chunks of text and returns a value indicating if any antiprompt has been detected.
 - `StreamingTokenDecoder` decodes tokens into text, maintaining some internal state to handle single characters which are encoded as multiple tokens.

Added tests for these classes and updated StatelessExecutor to use them.

Removed most DeTokenize methods, marked the rest as obsolete (should always use a `StreamingTokenDecoder`).

2 years ago

3 Commits (bab6b65b61fc86c9462dff71c95139ea2dfbe416)