The key to using image generation AI successfully is to produce images that don’t look like the typical AI-generated images.

Tokyo is ranked the sixth most walkable city in the world

I personally bicycle and walk way more than driving, in total distance traveled over the past couple of years.
timeout.com/tokyo/news/tok…

I’m looking forward to the tens of thousands of PEFT’ed Llama-3 70B and 400B models with various new superpowers that will be created and released by the community.

Almost 10 years ago I released MarI/O, a neural network that taught itself to play video games using Neuro Evolution of Augmenting Topologies (NEAT).

Check out my new interview with Ken Stanley, the author of NEAT:

youtu.be/5zg_5hg8Ydo

Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey

PEFT algorithms are useful for dealing with LLMs with high parameter counts, as even fine-tuning these models from scratch can be computationally expensive and resource-intensive.

arxiv.org/abs/2403.14608

Totoro cloud ☁️

Congrats Microsoft for the open release of Phi-3, their next generation of fast and capable model!

We've collected 6K+ votes for Phi-3 and pushed a new leaderboard release. The model is definitely showing great potentials of its size. Excited to see more community fine-tunes!

Biggest safety risk of AI is concentration of power and I doubt this board will help fight it!

Japan’s New Appetite for Risk Lures Venture Investors to Tokyo

“If we had started Sakana AI in the Bay Area, it would have been a strategic blunder, because we would have looked more like everyone else. It would have been very hard to differentiate.”

theinformation.com/articles/japan…

Where is mind?

“Meta does everything OpenAI should be”

Discussion on r/MachineLearning 🔥
redd.it/1cbhec7

We are looking to hire an HR & Accounting manager to help Sakana AI expand, as we grow our team!

If you are interested, or know someone who might be, please check out our careers website for more information: sakana.ai/careers

🎉 Great news for model merging!

Charles Goddard implemented an evolutionary technique à la Sakana AI to MergeKit (cc hardmaru)

He also released an excellent tutorial on how to use it with lm-evaluation-harness and vllm.

📝 Article: blog.arcee.ai/tutorial-tutor…

Sakana AIが提案した「進化的モデルマージ」により構築した画像生成モデル「EvoSDXL-JP」を公開しました。構築したモデルは日本語に対応しており、従来の日本語モデルと比べ10倍高速に画像を生成できます。

ブログ → sakana.ai/evosdxl-jp
デモ → huggingface.co/spaces/SakanaA…

Style Transfer Meme 👀

🦎Can we teach Transformers to perform in-context Evolutionary Optimization? Surely! We propose Evolutionary Algorithm Distillation for pre-training Transformers to mimic teachers 🧑‍🏫

🎉 Work done Google DeepMind 🗼with Yingtao Tian & Yujin Tang 🤗

📜: arxiv.org/abs/2403.02985

Super excited to share that I joined Sakana AI as a Research Scientist!

Looking forward to working with an amazing team to develop new nature-inspired methods and tackle some of AI's most relevant challenges ^^