![Shreya Shankar(@sh_reya) 's Twitter Profileg](https://pbs.twimg.com/profile_images/1342529111839944705/hzr44mb5_200x200.jpg)
Shreya Shankar
@sh_reya
I study ML & AI engineers and try to make their lives a little better. PhD-ing in databases & HCI @Berkeley_EECS @UCBEPIC and MLOps-ing around town. She/they.
ID:2286218053
http://www.sh-reya.com 11-01-2014 06:46:16
4,1K Tweets
39,6K Followers
598 Following
Follow People
![Shreya Shankar(@sh_reya) 's Twitter Profile Photo Shreya Shankar(@sh_reya) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1342529111839944705/hzr44mb5_200x200.jpg)
![Madelon Hulsebos(@MadelonHulsebos) 's Twitter Profile Photo Madelon Hulsebos(@MadelonHulsebos) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1358359933163601927/bntUzYzQ_200x200.jpg)
Why is finding the right dataset for analytics use-cases still time-consuming?
We surveyed ~90 practitioners on why, what, and how of dataset search, and surface key challenges and desired system capabilities 🚀!
paper: madelonhulsebos.com/assets/dataset…
talk: HILDA 2024 ACM SIGMOD’24✨!
![Madelon Hulsebos (@MadelonHulsebos) on Twitter photo 2024-05-20 16:50:34 Why is finding the right dataset for analytics use-cases still time-consuming? We surveyed ~90 practitioners on why, what, and how of dataset search, and surface key challenges and desired system capabilities 🚀! paper: madelonhulsebos.com/assets/dataset… talk: @hildaworkshop @sigmod’24✨! Why is finding the right dataset for analytics use-cases still time-consuming? We surveyed ~90 practitioners on why, what, and how of dataset search, and surface key challenges and desired system capabilities 🚀! paper: madelonhulsebos.com/assets/dataset… talk: @hildaworkshop @sigmod’24✨!](https://pbs.twimg.com/media/GOCUbObbgAAbfwi.png)
![Shreya Shankar(@sh_reya) 's Twitter Profile Photo Shreya Shankar(@sh_reya) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1342529111839944705/hzr44mb5_200x200.jpg)
![Shreya Shankar(@sh_reya) 's Twitter Profile Photo Shreya Shankar(@sh_reya) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1342529111839944705/hzr44mb5_200x200.jpg)
![Shreya Shankar(@sh_reya) 's Twitter Profile Photo Shreya Shankar(@sh_reya) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1342529111839944705/hzr44mb5_200x200.jpg)
![Shreya Shankar(@sh_reya) 's Twitter Profile Photo Shreya Shankar(@sh_reya) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1342529111839944705/hzr44mb5_200x200.jpg)
![Ian Arawjo (@ianarawjo@hci.social)(@IanArawjo) 's Twitter Profile Photo Ian Arawjo (@ianarawjo@hci.social)(@IanArawjo) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1093301210734424064/AnsYmRTP_200x200.jpg)
Ethan Mollick Why does everyone see these tools then say 'prompt engineering is dead'? It's just been emphasized even more! And how do we evaluate the prompt is better? 'Automatically generates good prompts' --how do we know it's good? It 'works pretty well' --what tests did you perform?
![Shreya Shankar(@sh_reya) 's Twitter Profile Photo Shreya Shankar(@sh_reya) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1342529111839944705/hzr44mb5_200x200.jpg)
![Shreya Shankar(@sh_reya) 's Twitter Profile Photo Shreya Shankar(@sh_reya) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1342529111839944705/hzr44mb5_200x200.jpg)
Agreed. daniel bashir is a fantastic interviewer. I remember being so impressed by all the preparation that went into my episode. I’ve never seen anything like it
![Shreya Shankar(@sh_reya) 's Twitter Profile Photo Shreya Shankar(@sh_reya) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1342529111839944705/hzr44mb5_200x200.jpg)
![Ian Arawjo (@ianarawjo@hci.social)(@IanArawjo) 's Twitter Profile Photo Ian Arawjo (@ianarawjo@hci.social)(@IanArawjo) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1093301210734424064/AnsYmRTP_200x200.jpg)
![Ivan Leo(@ivanleomk) 's Twitter Profile Photo Ivan Leo(@ivanleomk) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1524186822389026816/sWRHRIkY_200x200.jpg)
Elicit Grant Sanderson Ian Goodfellow Vik Paruchuri Shishir Patil 9/ Scaling up Vibe Checks by Shreya Shankar
I think she highlights an important fact that evals are going to be tricky because these models can freely improvise responses. I liked the interface and designs that she mentioned at the back and I think manual evaluation of generated
![Shreya Shankar(@sh_reya) 's Twitter Profile Photo Shreya Shankar(@sh_reya) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1342529111839944705/hzr44mb5_200x200.jpg)
![Ian Arawjo (@ianarawjo@hci.social)(@IanArawjo) 's Twitter Profile Photo Ian Arawjo (@ianarawjo@hci.social)(@IanArawjo) 's Twitter Profile Photo](https://pbs.twimg.com/profile_images/1093301210734424064/AnsYmRTP_200x200.jpg)