Commit Graph

7 Commits (ff05d05c960076b42f027e4d318cbd6ea59b3030)

Author SHA1 Message Date
Murilo Santana 5b70e7de4c
fix default params for examples/main (#697) 1 year ago
Slaren 0d054e292e Show error message when -f fails 1 year ago
Stephan Walter 436e561931
all : be more strict about converting float to double (#458)
* Be more strict about converting float to double

* Test equivalence of round, SILU implementations

Test module is commented out in CMakeLists.txt because the tests may
take a long time, depending on how much the compiler optimizes.

* Fix softmax in perplexity.cpp

* all : prefer float over double where appropriate

* perplexity : add <cmath>

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
1 year ago
anzz1 7b8dbcb78b
main.cpp fixes, refactoring (#571)
- main: entering empty line passes back control without new input in interactive/instruct modes
- instruct mode: keep prompt fix
- instruct mode: duplicate instruct prompt fix
- refactor: move common console code from main->common
1 year ago
Georgi Gerganov 79b2b266db
If n_predict == -1, generate forever 1 year ago
Georgi Gerganov e2d490dafd
Inifinite generation via context swapping (#71) 1 year ago
Georgi Gerganov a316a425d0
Overhaul the examples structure
- main -> examples
- utils -> examples (renamed to "common")
- quantize -> examples
- separate tools for "perplexity" and "embedding"

Hope I didn't break something !
1 year ago