Thrilled to receive a grant from Villum Fonden to carry out blue-skies research on tokenization-free NLP veluxfoundations.dk/en/about/proje… I will hire Ph.Ds and Postdocs to build up the group so feel free to reach out. We're starting off with a paper at #ICLR2023 openreview.net/forum?id=FkSp8…

📢 I am hiring a postdoc to join our project on pixel-based natural language processing. The position is based in Copenhagen 🇩🇰 for 18 months. Applications are due by March 29 employment.ku.dk/faculty/?show=…. Informal inquiries are welcome.

Vi har udviklet et nyt værktøj til dig, der gerne vil blive klogere på velstand og ulighed i Danmark. Værktøjet er gratis og kan vise udviklingen i indkomst, sundhed og uddannelse på landsplan og kommunalt niveau. Dyk ned i tallene på velstandogulighed.dk #dkforsk #dkøko

1/n Familial aggregation studies of diseases rely on familial information linked with health records. We investigated the completeness of familial links in the Danish Civil Registration System and described the future Danish Multi-Generation Register doi.org/10.1177/140349…

Looking forward to seeing everyone in Kigali for #ICLR2023! Phillip Rust will give his oral on the PIXEL LM on Wednesday in Oral 6 Track 5, 1500-1510 Elizabeth Salesky will give a talk about Visual Text Representations at AfricaNLP on Friday at 1045-1125.

I'm hiring a postdoc for 18 months to work with us on tokenization-free NLP in Copenhagen. Applications are due by August 31: di.ku.dk/english/about/…. Don't hesitate to reach out with informal inquiries.

Looking forward to the Advanced Data Methods Workshop @ENSdeLyon on September 14-15! An opportunity to keep abreast of the latest research on cutting-edge topics such as remote sensing, OCR/HTR, table and map recognition. Details and registration: enguehard.tf/talk/advanced-…

@AlexisLitvine @ENSdeLyon Fascinating presentation by Jonas Færch Lotz on date recognition in historical parish records - part of a whole session devoted to advances in data extraction from tabular documents with T. Paquet, C.M. Dahl, @AlexisLitvine, still #AdvancedMethods Workshop @ENSdeLyon

I am hiring up to two Ph.D students to work on tokenization-free language modelling at the University of Copenhagen. Find out more about our group: lampgroup.github.io and apply by November 15th and list me as a potential supervisor.

"Text Rendering Strategies for Pixel Language Models” Draft link: coming soon! By Jonas Færch Lotz, Elizabeth Salesky, Phillip Rust, Desmond Elliott TLDR — Compressing the input space of pixel-based language models improves performance and is more parameter-efficient.

Text Rendering Strategies for Pixel Language Models Simple character bigram rendering brings improved performance, which makes a model perform on par with 3x larger model arxiv.org/abs/2311.00522

Text Rendering Strategies for Pixel Language Models paper page: huggingface.co/papers/2311.00… Pixel-based language models process text rendered as images, which allows them to handle any script, making them a promising approach to open vocabulary language modelling. However, recent

In Text Rendering Strategies for Pixel Language Models with Jonas Færch Lotz Phillip Rust and Elizabeth Salesky, we design new text renderers for visual language processing to improve performance or to squeeze the model down to just 22M parameters. See it in Poster Session 2 on Friday 8th.

✴ Hiring a Postdoctoral Researcher ✴ I am hiring a postdoc with a background in *vision and language processing*, on a 2/3 year contract. Application deadline: 15 Feb 2024 Start: ASAP Apply here: mbzuai.ac.ae/vacancy/postdo… and contact me here or via email. #NLProc #hiring

Introducing “Towards Privacy-Aware Sign Language Translation at Scale” We leverage self-supervised pretraining on anonymized videos, achieving SOTA ASL-to-English translation performance while mitigating risks arising from biometric data. 📄: arxiv.org/abs/2402.09611 🧵(1/9)

Overcoming Vocabulary Constraints with Pixel-level Fallback. arxiv.org/abs/2504.02122

Announcing our recent work “Multilingual Pretraining for Pixel Language Models”! We introduce PIXEL-M4, a pixel language model pretrained on four visually & linguistically diverse scripts: English, Hindi, Ukrainian & Simplified Chinese. #NLProc