AI & ML interests

None defined yet.

Recent Activity

davidberenstein1957Β 
posted an update 7 months ago
davidberenstein1957Β 
posted an update 12 months ago
davidberenstein1957Β 
posted an update about 1 year ago
view post
Post
422
🚨 LLMs recognise bias but also reproduce harmful stereotypes: an analysis of bias in leading LLMs

I've written a new entry in our series on the Giskard, BPIFrance and Google Deepmind Phare benchmark(phare.giskard.ai).

This time it covers bias: https://huggingface.co/blog/davidberenstein1957/llms-recognise-bias-but-also-produce-stereotypes

Previous entry on hallucinations: https://huggingface.co/blog/davidberenstein1957/phare-analysis-of-hallucination-in-leading-llms
  • 1 reply
Β·
davidberenstein1957Β 
posted an update about 1 year ago
davidberenstein1957Β 
posted an update about 1 year ago
sharpenbΒ 
posted an update about 1 year ago
view post
Post
3216
How to learn about efficient AI? - Happy to announce the Awesome AI Efficiency repo that gathers a curated list of 100+ materials to understand the challenges and solutions in making AI faster, smaller, cheaper, greener.

πŸš€ It is designed for a **large audience** including beginners, decision-makers, engineers, and researchers.
πŸ“š It contains **diverse materials** with newspaper articles, blogs, tools, tech reports, research papers, books, and lectures.

This is an ongoing project. Do not hesitate to share your feedback/suggestions and star the repo! 🌟

https://github.com/PrunaAI/awesome-ai-efficiency
  • 2 replies
Β·
davidberenstein1957Β 
posted an update about 1 year ago
davidberenstein1957Β 
posted an update over 1 year ago
davidberenstein1957Β 
posted an update over 1 year ago
view post
Post
1415
RealHarm: A Collection of Real-World Language Model Application Failure

I'm David from Giskard, and we work on securing your Agents.
Today, we are launching RealHarm: a dataset of real-world problematic interactions with AI agents, drawn from publicly reported incidents.

Check out the dataset and paper: https://realharm.giskard.ai/
davidberenstein1957Β 
posted an update over 1 year ago
view post
Post
2118
🚨 New Bonus Unit: Tracing & Evaluating Your Agent! 🚨

Learn how to transform your agent from a simple demo into a robust, reliable product ready for real users.

UNIT: https://huggingface.co/learn/agents-course/bonus-unit2/introduction

In this unit, you'll learn:
- Offline Evaluation – Benchmark and iterate your agent using datasets.
- Online Evaluation – Continuously track key metrics such as latency, costs, and user feedback.

Happy testing and improving!

Thanks Langfuse team!
sharpenbΒ 
posted an update over 1 year ago
view post
Post
3122
We open-sourced the pruna package that can be easily installed with pip install pruna :) It allows to easily ccompress and evaluate AI models including transformers and diffusers.

- Github repo: https://github.com/PrunaAI/pruna
- Documentation: https://docs.pruna.ai/en/stable/index.html

With open-sourcing, people can now inspect and contribute to the open code. Beyond the code, we provide detailed readme, tutorials, benchmarks, and documentation to make transparent compression, evaluation, and saving/loading/serving of AI models.

Happy to share it with you and always interested in collecting your feedback :)
  • 2 replies
Β·
davidberenstein1957Β 
posted an update over 1 year ago
davidberenstein1957Β 
posted an update over 1 year ago
view post
Post
4273
πŸ₯Š Epic Agent Framework Showdown! Available today!

πŸ”΅ In the blue corner, the versatile challenger with a proven track record of knowledge retrieval: LlamaIndex!

πŸ›‘ In the red corner, the defender, weighing in with lightweight efficiency: Hugging Face smolagents!

πŸ”— URL:
agents-course


We just published the LlamaIndex unit for the agents course, and it is set to offer a great contrast between the smolagents unit by looking at

- What makes llama-index stand-out
- How the LlamaHub is used for integrations
- Creating QueryEngine components
- Using agents and tools
- Agentic and multi-agent workflows

The team has been working flat-out on this for a few weeks. Supported by Logan Markewich and Laurie Voss over at LlamaIndex.

Who won? You decide!
davidberenstein1957Β 
posted an update over 1 year ago
view post
Post
3063
🫸 New release to push vector search to the Hub with vicinity and work with any serialisable objects.

πŸ§‘β€πŸ« KNN, HNSW, USEARCH, ANNOY, PYNNDESCENT, FAISS, and VOYAGER.

πŸ”— Example Repo: minishlab/my-vicinity-repo
davidberenstein1957Β 
posted an update over 1 year ago
view post
Post
3332
πŸš€ Find banger tools for your smolagents!

I created the Tools gallery, which makes tools specifically developed by/for smolagents searchable and visible. This will help with:
- inspiration
- best practices
- finding cool tools

Space: davidberenstein1957/smolagents-and-tools
  • 1 reply
Β·