Using TOON to replace json

[kevngzc]

Could it be interesting to store data of index in TOON format instead of json and update retrieval in order to save token ?

https://github.com/toon-format/toon

[Rohith-Kaki]

Yeah, its a cool thing to integrate and save tokens.

[omkar-12bits]

You can but that won't be a good idea for production systems, as TOON is a newly emerged format. LLM's are not familiar with it, an can degrade the accuracy.
So Its better to stick with format LLMs are confident or got trained on.

[arnavbansal2764]

Actually TOON performs better than json, not only it saves tokens but llms are able to provide better results. I was working on a project where I passed data in json and then switched to toon, that gave me a good performance jump.