{"id":838,"date":"2023-09-21T07:47:17","date_gmt":"2023-09-21T07:47:17","guid":{"rendered":"https:\/\/tbekk.com\/devstream\/?p=838"},"modified":"2023-09-21T07:48:29","modified_gmt":"2023-09-21T07:48:29","slug":"weekly-ai-and-nlp-news-september-11th-2023","status":"publish","type":"post","link":"https:\/\/tbekk.com\/devstream\/2023\/09\/21\/weekly-ai-and-nlp-news-september-11th-2023\/","title":{"rendered":"Weekly AI and NLP News \u2014 September 11th 2023"},"content":{"rendered":"\n<h2 class=\"wp-block-heading has-medium-gray-color has-text-color\">The 100 most influential people in AI, Falcon 180B, and an open-source Code Interpreter<\/h2>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-light-gray-color has-alpha-channel-opacity has-light-gray-background-color has-background is-style-wide\"\/>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong><em>Link:<\/em><\/strong> <em><a href=\"https:\/\/medium.com\/nlplanet\/weekly-ai-and-nlp-news-september-11th-2023-7e3cd53fa508\">https:\/\/medium.com\/nlplanet\/weekly-ai-and-nlp-news-september-11th-2023-7e3cd53fa508<\/a><\/em><\/li>\n\n\n\n<li><strong><em>Author:<\/em><\/strong> <a href=\"https:\/\/medium.com\/@chiusanofabio94?source=post_page-----7e3cd53fa508--------------------------------\"><em>Fabio Chiusano<\/em><\/a><\/li>\n\n\n\n<li><em><strong>Publicayion date:<\/strong> September 11, 2023<\/em><\/li>\n<\/ul>\n\n\n\n<hr class=\"wp-block-separator has-text-color has-light-gray-color has-alpha-channel-opacity has-light-gray-background-color has-background is-style-wide\"\/>\n\n\n\n<h1 class=\"wp-block-heading\" id=\"6d4e\">\ud83d\ude0e News From The Web<\/h1>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/time.com\/collection\/time100-ai\/\" rel=\"noreferrer noopener\" target=\"_blank\">The 100 Most Influential People in AI 2023<\/a>. TIME magazine has released its list of the 100 Most Influential People in AI for 2023. The list includes notable figures such as Dario and Daniela Amodei, Sam Altman, Demis Hassabis, Robin Li, Cl\u00e9ment Delangue, Lila Ibrahim, Elon Musk, Geoffrey Hinton, Fei-Fei Li, Timnit Gebru, Yann LeCun, and Yoshua Bengio.<\/li>\n\n\n\n<li><a href=\"https:\/\/huggingface.co\/blog\/falcon-180b\" rel=\"noreferrer noopener\" target=\"_blank\">Spread Your Wings: Falcon 180B is here<\/a>. TII has just released Falcon 180B, a powerful language model with 180 billion parameters trained on 3.5 trillion tokens. Outperforming Llama 2 70B and GPT-3.5 on MMLU, Falcon 180B performs great and ranks high on the Hugging Face Leaderboard. This model is available for commercial use but has strict terms excluding \u201chosting use.\u201d<\/li>\n\n\n\n<li><a href=\"https:\/\/www.adept.ai\/blog\/persimmon-8b\" rel=\"noreferrer noopener\" target=\"_blank\">Releasing Persimmon-8B<\/a>. Adept.ai introduces Persimmon-8B, an open-source LLM with impressive performance and a compact size. Trained on less data, it achieves comparable results to LLaMA2 and offers fast C++ implementation combined with flexible Python inference.<\/li>\n\n\n\n<li><a href=\"https:\/\/huggingface.co\/training-cluster\" rel=\"noreferrer noopener\" target=\"_blank\">Training Cluster as a service: Train your LLM at scale on our infrastructure<\/a>. Hugging Face provides cost estimates for training large language models (LLMs) of different sizes and token counts. The estimates range from $65k to $14.66M, depending on the model parameters and token count.<\/li>\n\n\n\n<li><a href=\"https:\/\/huggingface.co\/spaces\/hf-audio\/open_asr_leaderboard\" rel=\"noreferrer noopener\" target=\"_blank\">Open ASR Leaderboard<\/a>. Hugging Face has released a speech-to-text leaderboard that ranks and assesses speech recognition models on their platform. The current top performers are NVIDIA FastConformer and OpenAI Whisper, with a focus on English speech recognition. Multilingual evaluation will be added in future updates.<\/li>\n<\/ul>\n\n\n\n<h1 class=\"wp-block-heading\" id=\"f529\">\ud83d\udcda Guides From The Web<\/h1>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/pub.towardsai.net\/create-a-self-moderated-commentary-system-with-langchain-and-openai-406a51ce0c8d\" rel=\"noreferrer noopener\" target=\"_blank\">Create a Self-Moderated Commentary System with LangChain and OpenAI<\/a>. This guide explains the steps to build a self-moderated comment response system using OpenAI and LangChain. It involves two models, where the first generates a response and the second modifies and publishes it.<\/li>\n\n\n\n<li><a href=\"https:\/\/www.pinecone.io\/learn\/llm-ecosystem\/\" rel=\"noreferrer noopener\" target=\"_blank\">LLMs Are Not All You Need<\/a>. LLMs have limitations such as generating false information and lack of up-to-date content. To harness their full potential, a well-designed ecosystem is necessary. This involves prompt engineering, utilizing techniques like quantization, retrieval augmented generation (RAG), and conversational memory.<\/li>\n\n\n\n<li><a href=\"https:\/\/pub.towardsai.net\/gptq-quantization-on-a-llama-2-7b-fine-tuned-model-with-huggingface-a7b291fbb871\" rel=\"noreferrer noopener\" target=\"_blank\">GPTQ Quantization on a Llama 2 7B Fine-Tuned Model With HuggingFace<\/a>. HuggingFace has introduced GPTQ quantization, enabling the compression of large language models to 2, 3, or 4 bits. This method outperforms previous techniques, maintaining accuracy while significantly reducing model size.<\/li>\n\n\n\n<li><a href=\"https:\/\/eugeneyan.com\/writing\/abstractive\/\" rel=\"noreferrer noopener\" target=\"_blank\">Evaluation &amp; Hallucination Detection for Abstractive Summaries<\/a>. Abstractive summarization faces challenges in evaluating hallucinations, with difficulties in measuring relevance and consistency objectively. Evaluating summaries using metrics like ROUGE and BERTScore has limitations, especially outside of reference distributions. Detecting inconsistencies between summary and source document is crucial, with advancements in entailment-based and QA metrics.<\/li>\n\n\n\n<li><a href=\"https:\/\/arstechnica.com\/cars\/2023\/09\/are-self-driving-cars-already-safer-than-human-drivers\/\" rel=\"noreferrer noopener\" target=\"_blank\">Are self-driving cars already safer than human drivers?<\/a>&nbsp;Early data suggests that self-driving cars, such as Waymo and Cruise driverless taxis, may be safer than human drivers. Despite experiencing 102 crashes within 6 million miles, most incidents were low-speed collisions caused by other drivers.<\/li>\n<\/ul>\n\n\n\n<h1 class=\"wp-block-heading\" id=\"199f\">\ud83d\udd2c Interesting Papers and Repositories<\/h1>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/github.com\/KillianLucas\/open-interpreter\" rel=\"noreferrer noopener\" target=\"_blank\">KillianLucas\/open-interpreter: OpenAI\u2019s Code Interpreter in your terminal, running locally<\/a>. Open Interpreter is an open-source implementation of OpenAI\u2019s Code Interpreter that provides a natural language interface similar to ChatGPT. It enables running various code types locally, offering interactive terminal chats for controlling computer functions without internet access limitations.<\/li>\n\n\n\n<li><a href=\"https:\/\/arxiv.org\/abs\/2309.03409\" rel=\"noreferrer noopener\" target=\"_blank\">Large Language Models as Optimizers<\/a>. LLMs can be used as optimizers in applications where gradients are not available. Optimization by PROmpting (OPRO) involves the LLM generating new solutions from a prompt, which are then evaluated and used to refine the prompt in a constant optimization cycle. OPRO has shown promising results, outperforming human-designed prompts in prompt optimization tasks.<\/li>\n\n\n\n<li><a href=\"https:\/\/arxiv.org\/abs\/2309.03179\" rel=\"noreferrer noopener\" target=\"_blank\">SLiMe: Segment Like Me<\/a>. SLiMe, a novel approach that combines vision-language models and Stable Diffusion (SD), allows image segmentation at custom granularity using just one annotated sample. It outperforms existing one-shot and few-shot image segmentation methods, as demonstrated in comprehensive experiments. \ud83d\uddbc\ufe0f<\/li>\n\n\n\n<li><a href=\"https:\/\/arxiv.org\/abs\/2309.03852\" rel=\"noreferrer noopener\" target=\"_blank\">FLM-101B: An Open LLM and How to Train It with $100K Budget<\/a>. The authors present a growth-oriented strategy to train a cost-effective LLM model with 101B parameters and 0.31TB tokens for just $100K. They also introduce a new evaluation method focused on IQ-level analysis, showcasing the model\u2019s performance on par with top models like GPT-3 and GLM-130B in IQ benchmark evaluations.<\/li>\n\n\n\n<li><a href=\"https:\/\/arxiv.org\/abs\/2309.01826\" rel=\"noreferrer noopener\" target=\"_blank\">One Wide Feedforward is All You Need<\/a>. Researchers have found that the Feed Forward Network (FFN) in Transformers can be optimized, resulting in a 40% reduction in model size while maintaining similar performance. By sharing a FFN across the encoder and removing it from the decoder layers, parameters can be decreased with minimal decrease in accuracy.<\/li>\n\n\n\n<li><a href=\"https:\/\/arxiv.org\/abs\/2309.00754\" rel=\"noreferrer noopener\" target=\"_blank\">Efficient RLHF: Reducing the Memory Usage of PPO<\/a>. The authors present Hydra-PPO, a method to accelerate Reinforcement Learning from Human Feedback (RLHF) by reducing memory usage. Hydra-PPO reduces the number of models in memory during the PPO stage, allowing for increased training batch size and decreased per-sample latency by up to 65%.<\/li>\n\n\n\n<li><a href=\"https:\/\/speechresearch.github.io\/prompttts2\/\" rel=\"noreferrer noopener\" target=\"_blank\">PromptTTS 2: Describing and Generating Voices with Text Prompt<\/a>. PromptTTS 2 is a Text-to-Speech system that can control attributes like Gender, Speed, Pitch, and Volume using text prompts. It can also match synthesized voices to facial images while maintaining timbre.<\/li>\n<\/ul>\n\n\n\n<p id=\"a77e\">Thank you for reading! If you want to learn more about NLP, remember to follow&nbsp;<a href=\"https:\/\/www.nlplanet.org\/\" rel=\"noreferrer noopener\" target=\"_blank\">NLPlanet<\/a>. You can find us on&nbsp;<a href=\"https:\/\/www.linkedin.com\/company\/nlplanet\" rel=\"noreferrer noopener\" target=\"_blank\">LinkedIn<\/a>,&nbsp;<a href=\"https:\/\/twitter.com\/nlplanet_\" rel=\"noreferrer noopener\" target=\"_blank\">Twitter<\/a>,&nbsp;<a href=\"https:\/\/medium.com\/nlplanet\">Medium<\/a>, and our&nbsp;<a href=\"https:\/\/discord.gg\/zfC862H2dJ\" rel=\"noreferrer noopener\" target=\"_blank\">Discord server<\/a>!<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The 100 most influential people in AI, Falcon 180B, and an open-source Code Interpreter \ud83d\ude0e News From The Web \ud83d\udcda Guides From The Web \ud83d\udd2c Interesting Papers and Repositories Thank&#8230; <a class=\"read-more-link\" href=\"https:\/\/tbekk.com\/devstream\/2023\/09\/21\/weekly-ai-and-nlp-news-september-11th-2023\/\">Read more &raquo;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[181,19,201],"tags":[27,20,302,40],"class_list":["post-838","post","type-post","status-publish","format-standard","hentry","category-ai-2","category-ml","category-nlp","tag-ai","tag-ml","tag-news","tag-nlp"],"_links":{"self":[{"href":"https:\/\/tbekk.com\/devstream\/wp-json\/wp\/v2\/posts\/838","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/tbekk.com\/devstream\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/tbekk.com\/devstream\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/tbekk.com\/devstream\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/tbekk.com\/devstream\/wp-json\/wp\/v2\/comments?post=838"}],"version-history":[{"count":1,"href":"https:\/\/tbekk.com\/devstream\/wp-json\/wp\/v2\/posts\/838\/revisions"}],"predecessor-version":[{"id":839,"href":"https:\/\/tbekk.com\/devstream\/wp-json\/wp\/v2\/posts\/838\/revisions\/839"}],"wp:attachment":[{"href":"https:\/\/tbekk.com\/devstream\/wp-json\/wp\/v2\/media?parent=838"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/tbekk.com\/devstream\/wp-json\/wp\/v2\/categories?post=838"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/tbekk.com\/devstream\/wp-json\/wp\/v2\/tags?post=838"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}