Currently on my list for what to build better datasets around to improve on Hermes 2.5 (in no particular order):
---
Function calling
Dpo dataset
Logic puzzles
Roleplaying
Multiturn Chats
System prompt usefulness
Dataforge expert knowledge & tasks
Internal monologuing
Paradoxes…