Open Problems in Mechanistic Interpretability: A Whirlwind Tour

expand_more

1 views1 year ago

thumb_upLike

thumb_downDislike

library_addSave

flagReport

Google TechTalks check_circle

1K subscribers

A Google TechTalk, presented by Neel Nanda, 2023/06/20 Google Algorithms Seminar - ABSTRACT: Mechanistic Interpretability is the study of reverse engineering the learned algorithms in a trained neural network, in the hopes of applying this understanding to make powerful systems safer and more steerable. In this talk Neel will give an overview of the field, summarise some key works, and outline what he sees as the most promising areas of future work and open problems. This will touch on techniques in casual abstraction and meditation analysis, understanding superposition and distributed representations, model editing, and studying individual circuits and neurons. About the Speaker: Neel works on the mechanistic interpretability team at Google DeepMind. He previously worked with Chris Olah at Anthropic on the transformer circuits agenda, and has done independent work on reverse-engineering modular addition and using this to understand grokking.

vid:185998

Comments0

unfold_more

01:06:53

5 Terrifying Mysteries That Can't Be Explained

more_vert

What Lurks Beneath check_circle

3K views 1 day ago

,Today we're going to look at five terrifying mysteries that have baffled experts and investigators for years. These aren't your typical unsolved cases - these are the kind that make you question everything you thought you knew about reality. From a hotel room covered in unexplainable blood to a bypass where people keep vanishing without a trace, these stories will show you that sometimes the truth is far scarier than fiction. #mysteries #truestory #legends 👉SUBSCRIBE https://bit.ly/Subscribe-To-WLB 👉SUBMIT YOUR STORIES TO: stories@whatlurksbeneath.com 💀Secrets Of The Woods (Oldschool WLB) https://www.youtube.com/channel/UC8ReCxVNMTOM6cTtsiSYrSA 💀WHAT LURKS ABOVE STORIES https://www.youtube.com/channel/UCGCAey-WEDN9QbeDg_3vnYA 👉JOIN MY DISCORD: https://discord.gg/5jUDGrxQTF 🎥 MY GEAR 🎥 My Speakers: https://amzn.to/3ChzoUX Speaker Stands: https://amzn.to/3QCnwRN My Microphone: https://amzn.to/3A6Oius Backup Microphone: https://amzn.to/3K4zpNK Mic Arm: https://amzn.to/3Kh4wWR Burl AD Converter: https://amzn.to/3SXlY6w Preamp: https://amzn.to/3PwQ9hR Poweramp: https://amzn.to/3A4r8VB My Camera: https://amzn.to/3PuIO2n My Lens: https://amzn.to/3wcjhEd Camera Adapter: https://amzn.to/3A1nLyN Backup Camera: https://amzn.to/3PuqmXx Teleprompter: https://amzn.to/3A6Piic Monitors: https://amzn.to/3K23uO4 Audio Interface: https://amzn.to/3QzcIUD Backup Interface: https://amzn.to/3Cdbp9r On-The-Go Interface: https://amzn.to/3QPp1M3 Elgato Streamdeck: https://amzn.to/3Cee8PO Macro Controller: https://amzn.to/3QPp3DF My Mouse: https://amzn.to/3ds6jM8 My Keyboard: https://amzn.to/3c5awoL LED Lights: https://amzn.to/3wexktc Lighting: https://amzn.to/3At0PtC LED BG Lights: https://amzn.to/3PuOdXm Sound Proofing: https://amzn.to/3c8vnYd And: https://amzn.to/3QNqd2A Green Screen: https://amzn.to/3JZFPOo Backdrop Stand: https://amzn.to/3ClVcP8 Coffee: https://amzn.to/3wbt6m7 What Lurks Beneath YouTube Channel is a participant in the Amazon Services LLC Associates Program, an affiliate advertising program designed to provide a means for sites to earn advertising fees by advertising and linking to Amazon.com. 👉LISTEN ON SPOTIFY: https://open.spotify.com/show/6BqFWcTY457HUsR3eJZ91a 👉Follow Me on Instagram! https://bit.ly/wlb-instagram 👉Like Me on Facebook! http://bit.ly/WLBfb ►Your Ultimate VPN Solution: http://www.expressvpn.com/whatlurksbeneath What Lurks Beneath is a channel focused on true scary stories and true horror stories, I cover the supernatural cryptids, bigfoot, dogman and scary mysteries. In this channel, you'll find storytelling of the unkown, the supernatural and the paranormal. If you enjoy shows like Unsolved Mysteries or Paranormal Witness, you'll enjoy What Lurks Beneath

00:05:27

Megyn Kelly Unloads on Trump's Surgeon General Pick and Her COVID Past, with Burguiere and RedSteeze

more_vert

Megyn Kelly check_circle

48K views 1 day ago

02:43:04

New DMT Experiment Finds 'Alien Code' Hidden in the Fabric of Reality | Danny Goler

more_vert

KONCRETE check_circle

5K views 1 day ago

01:27:49

Wack Goes to War with the Mexicans! Will Young Thug Fall Off? Adam & Wack Having More Kids??

more_vert

No Jumper check_circle

34K views 2 days ago

00:11:56

Los Angeles Failed Monorail Plan

more_vert

IT'S HISTORY check_circle

15K views 3 days ago

,Thank you to Holzkern for sponsoring this video! Click my link http://www.holzkern.com/itshistory to save up to 30% site-wide in their biggest sale of the year—limited time only! 00:00 - Disney’s Monorail Dream 01:19 - The Cutting Edge of Urban Transit 02:29 - A Grand Opening at Disneyland 03:45 - The Roots of the Monorail Concept 05:00 - Walt Disney and Axel Wenner-Gren Collaborate 06:18 - From Disneyland to LA: A Bold Proposal 07:44 - Opposition and the Death of the LA Monorail 09:08 - The Legacy of Disney’s Monorail 10:27 - A Visionary’s Urban Transit Dream Why doesn’t Los Angeles have a monorail? In this episode of It’s History, we dive into Disney’s ambitious plan to transform LA’s transportation network with a futuristic monorail system. Discover how Walt Disney’s innovative vision aimed to solve LA’s traffic problems and why it ultimately failed. From behind-the-scenes politics to logistical challenges, we uncover the untold story of Disney’s monorail dream and the lasting impact it could have had on Los Angeles. Join us as we explore the history of this ambitious project, the opposition it faced, and how it fits into the broader story of urban transportation in the United States. Don’t forget to like, comment, and subscribe for more fascinating stories about the history of cities, transportation, and iconic innovations! Support us on the Patreon 👉 https://patreon.com/RyanSocash Support the Channel by becoming a member 👉 https://youtube.com/channel/UCzIZ8HrzDgc-pNQDUG6avBA/join #LosAngelesHistory #DisneyMonorail #UrbanTransportation #MonorailHistory #FailedProjects #DisneyHistory #TransportationFails #LosAngelesTraffic #UrbanPlanning #ItsHistory IT’S HISTORY - Weekly Tales of American Urban Decay as presented by your host Ryan Socash. https://www.youtube.com/playlist?list=PL2NN2rktA4yMZ4vmNaA3KpsS5KXLj3xVN » Subscribe: https://youtube.com/@ITSHISTORY?sub_confirmation=1 » Listen podcasts: https://ffm.bio/itshistory » CONTACT For brands, agencies, and sponsorships: itshistory@thoughtleaders.io Click here to book a sponsorship with me thoughtleaders.io/reserve/its-history » CREDIT Editor - Karolina Szwata Host - Ryan Socash Music/Sound Design: Dave Daddario » NOTICE Some images may be used for illustrative purposes only - always reflecting the accurate time frame and content. Events of factual error / mispronounced word/spelling mistakes - retractions will be published in this section.

00:56:22

AI Snake Oil

more_vert

Google TechTalks check_circle

787 views 4 days ago

02:00:24

Joe Rogan Experience #2233 - Scott Storch

more_vert

PowerfulJRE check_circle

731K views 4 days ago

00:02:04

Global Warming Worries William Shatner the Most

more_vert

Club Random Podcast check_circle

2K views 4 days ago

05:05:15

“GHOST WHO TALKED TOO MUCH” and MORE Old-Time Radio Tales! EPISODE 0250 #RetroRadio #WeirdDarkness

more_vert

Weird Darkness: Paranormal, True Crime, Macabre check_circle

180 views 5 days ago

00:25:23

“It’s GROSS!” AOC GOES TO WAR w/ Nancy Mace over Trans Bathroom

more_vert

Breaking Points check_circle

94K views 5 days ago

00:36:14

"You're SICK!" Nancy Mace OBLITERATES Woke ABC News Reporter!

more_vert

The Officer Tatum check_circle

13K views 6 days ago

00:10:42

Every Generation Explained in 10 minutes

more_vert

The Infographics Show check_circle

10K views 6 days ago

00:00:59

Trump and China -- Trade as a Proxy Tool | China Considered

more_vert

Hoover Institution check_circle

374 views 1 week ago

00:05:46

Megyn on Katie Couric Wondering Why Kamala Couldn't Answer a "G-D Question"...But What Did She Ask?

more_vert

Megyn Kelly check_circle

11K views 1 week ago

00:01:34

The Ultimate "Shangri La" Launiupoko Cottage

more_vert

Hawaii Real Estate check_circle

1K views 1 week ago

00:01:00

Sony's New LinkBuds Open and LinkBuds Fit Review

more_vert

CNET check_circle

2K views 1 week ago

00:07:40

The Extreme Engineering Behind Washington, D.C.

more_vert

TDC check_circle

4K views 1 week ago

,Imagine causing a sinkhole that collapses the Washington Monument? Subscribe to TDC: https://www.youtube.com/TheDailyConversation/ Main Sources: DC Flood Risks https://www.washingtonpost.com/climate-environment/interactive/2023/dc-low-lying-city-flood-risks/ Potomac Basin https://potomacdwspp.org/resources/about-the-potomac-basin/ Flood proofing Federal Triangle https://www.youtube.com/watch?v=goFC7H8DN5o CBS: Rising Waters in Tidal Basin https://www.youtube.com/watch?v=CPLedIobHRw New Flood Wall https://youtu.be/XMFcJ_ttSZI?si=1clHozSB2nlmKnV4&t=62 DC Water's Clean Rivers PDF https://www.dcwater.com/sites/default/files/project/2016-12/presentations/2024-04-10%20WABA%20%28WPP%29%20Briefing%20Presentation.pdf DC Clean Rivers video https://www.youtube.com/watch?v=bCOXuWgPnXw Lady Bird Tunnel Boring Machine https://youtu.be/J5oEqtpB1go?si=1LgeBHozH_k9x1_u&t=69 Tour of Blue Plains Wastewater Treatment Plant https://youtu.be/Rm_iyxwAx94?si=NCL1T0C_B-RLsOCY That nightmare scenario haunted the team excavating the 75 foot-deep site for the National Museum of African American History and Culture after they accidentally hit the aquifer under the National Mall. If too much water gushed into their giant pit, they could destabilize their neighbor, the great structure just a few hundred feet away, causing it to shift or even fall over. So they acted quickly to pump water back in to stabilize it. When their instruments showed the ground pressure holding firm, they plugged up the leak and focused on modifying the museum’s design to mitigate this new risk. To maximize its exhibit space, while limiting its above ground footprint, the museum’s first four levels are underground. To keep them dry, visitors safe, and the 91,000-ton monument next door standing tall, they encased the subterranean levels in two walls, with eight feet of porous stone fill in between, to catch and hold any water that might penetrate the foundation. It was an ingenious solution, but for builders in the federal District of Columbia, dealing with a shallow water table is nothing new. When President George Washington chose this idyllic spot to be the national capital, it was a land of farms and woods, rich with surface water. Small brooks trickled into streams, like Rock Creek. Marshes and tidal flats swelled and receded as the 14,700 square-mile Potomac basin drained through the District and mixed with the tidal flow of the Chesapeake Bay–the largest estuary in the United States. But as the city's boulevards and grand buildings were constructed over the past two-and-a-half centuries, 70% of these natural streams have disappeared: diverted into sewers, culverts, or filled in and paved over. Tiber Creek flowed through what has become the National Mall. First, it was converted into a canal, and then piped into sewers buried beneath Federal Triangle. Today, this group of large neoclassical buildings - between Constitution and Pennsylvania Avenues - is home to numerous large government agencies. It’s also the lowest point in downtown. In 2006 it rained heavily for an entire week, leaving the Triangle submerged, causing tens of millions of dollars in damage and disrupting government operations. It wasn’t the first time this has happened here. Experts fear the most extreme storm would put the American History Museum under 16 feet of water. Engineers have taken steps to protect the buildings, like installing temporary barriers, retractable gates, and raising core utilities out of their basements. There’s even now a temporary levee that’s trucked over and dropped in along the Mall for added protection ahead of big storms. But throughout the rest of DC, an estimated 16,000 homes and businesses have had little protection from flooding when it rains. Some residents have water gush in from the street, others confront it bubbling up from their toilets when old sewers overflow and long-buried “zombie” streams gurgle back to life. On the southernmost edge of the district, along the Potomac, another major flooding threat looms. Over the past century, the waterline has effectively risen four feet, a combination of sea level rise and the land sinking under the weight of development. I’ve definitely noticed the water getting a little higher every year. The area where the water is is actually a portion of the seawall that has settled over the years. During high tide, when the ocean pushes the Chesapeake Bay further up the Potomac, 250 million gallons of river water enter the Tidal Basin. But it was constructed in 1897, it can no longer contain the river at high tide, causing the walking paths around the monuments and iconic cherry trees to flood twice a day like clockwork. Atlanta Megacity Megacities Detroit Pittsburgh Philadelphia Delhi Los Angeles Chicago Lincoln memorial capital one Georgetown highlights commanders wizards capitals art museum national history natural history Smithsonian MLK Obama Mall Metro FDR Jefferson

00:07:07

Iran MP Invokes Quran in Nuclear Weapon Call, Biden Asks G20 to Pressure Hamas, Houthis Warn Germany

more_vert

CRUX check_circle

3K views 1 week ago

00:08:56

Secret to prompt engineering | Lex Fridman Podcast

more_vert

Lex Clips check_circle

819 views 1 week ago

,Lex Fridman Podcast full episode: https://www.youtube.com/watch?v=ugvHCXCOmm4 Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/cv8236-sb See below for guest bio, links, and to give feedback, submit questions, contact Lex, etc. *GUEST BIO:* Dario Amodei is the CEO of Anthropic, the company that created Claude. Amanda Askell is an AI researcher working on Claude's character and personality. Chris Olah is an AI researcher working on mechanistic interpretability. *CONTACT LEX:* *Feedback* - give feedback to Lex: https://lexfridman.com/survey *AMA* - submit questions, videos or call-in: https://lexfridman.com/ama *Hiring* - join our team: https://lexfridman.com/hiring *Other* - other ways to get in touch: https://lexfridman.com/contact *EPISODE LINKS:* Claude: https://claude.ai Anthropic's X: https://x.com/AnthropicAI Anthropic's Website: https://anthropic.com Dario's X: https://x.com/DarioAmodei Dario's Website: https://darioamodei.com Machines of Loving Grace (Essay): https://darioamodei.com/machines-of-loving-grace Chris's X: https://x.com/ch402 Chris's Blog: https://colah.github.io Amanda's X: https://x.com/AmandaAskell Amanda's Website: https://askell.io *SPONSORS:* To support this podcast, check out our sponsors & get discounts: *Encord:* AI tooling for annotation & data management. Go to https://lexfridman.com/s/encord-cv8236-sb *Notion:* Note-taking and team collaboration. Go to https://lexfridman.com/s/notion-cv8236-sb *Shopify:* Sell stuff online. Go to https://lexfridman.com/s/shopify-cv8236-sb *BetterHelp:* Online therapy and counseling. Go to https://lexfridman.com/s/betterhelp-cv8236-sb *LMNT:* Zero-sugar electrolyte drink mix. Go to https://lexfridman.com/s/lmnt-cv8236-sb *PODCAST LINKS:* - Podcast Website: https://lexfridman.com/podcast - Apple Podcasts: https://apple.co/2lwqZIr - Spotify: https://spoti.fi/2nEwCF8 - RSS: https://lexfridman.com/feed/podcast/ - Podcast Playlist: https://www.youtube.com/playlist?list=PLrAXtmErZgOdP_8GztsuKi9nrraNbKKp4 - Clips Channel: https://www.youtube.com/lexclips *SOCIAL LINKS:* - X: https://x.com/lexfridman - Instagram: https://instagram.com/lexfridman - TikTok: https://tiktok.com/@lexfridman - LinkedIn: https://linkedin.com/in/lexfridman - Facebook: https://facebook.com/lexfridman - Patreon: https://patreon.com/lexfridman - Telegram: https://t.me/lexfridman - Reddit: https://reddit.com/r/lexfridman

00:01:00

JLP protest tactics

more_vert

BOND check_circle

49 views 1 week ago

,Clip from October 27, 2024 FULL VIDEO: Why do you need anyone else's approval? | Church 10/27/24 YouTube https://www.youtube.com/live/SSBqhwmWV2Y Rumble https://rumble.com/v5k4dl9-church-with-jesse-lee-peterson-102724.html BitChute https://www.bitchute.com/video/SSBqhwmWV2Y/ Facebook https://www.facebook.com/rebuildingtheman/videos/423653594111316 X https://x.com/JLPtalk/status/1850590787278721520 BLOG https://rebuildingtheman.com/why-do-you-need-anyone-elses-approval-church-10-27-24/ PODCAST / Substack https://rebuildingtheman.substack.com/p/why-do-you-need-anyone-elses-approval Apple https://podcasts.apple.com/us/podcast/why-do-you-need-anyone-elses-approval-church-10-27-24/id1173675223?i=1000674634665 Spotify https://open.spotify.com/episode/0OO99Oa8v44DNrBWp8L3Mv Castbox https://castbox.fm/episode/Why-do-you-need-anyone-else's-approval--%7C-Church-102724-id5330364-id748230301?country=us -- Church with Jesse Lee Peterson, Sunday 11 AM PT (1CT/2ET) at BOND in Los Angeles https://rebuildingtheman.com/church/ SILENT PRAYER: http://silentprayer.video | READ https://rebuildingtheman.com/prayer/ FOLLOW BOND RUMBLE (clips, archive) https://rumble.com/rebuildingtheman Silent Prayer on RUMBLE https://rumble.com/v14y4bi-silent-prayer-church-clip-april-11-2021.html PLAYLISTS: 2016-present https://www.youtube.com/playlist?list=PLVqjzIOc_QoP6przIhg6O1Iti9hzK9n1Q 2008-2014 https://www.youtube.com/playlist?list=PLVqjzIOc_QoNYs7rgye3uaXkmziRdj8mU 1991-1998 https://www.youtube.com/playlist?list=PLpSkvyhrlXrY13QSHcFUBMx0y_cZXl-94 All My Links https://allmylinks.com/jesseleepeterson BOOKS, TEES https://rebuildingtheman.com/stores/ DONATE http://rebuildingtheman.com/donate/ PAYPAL https://www.paypal.com/donate/?cmd=_s-xclick&hosted_button_id=VTBEDF3KCJAES&source=url ALT. MEDIA JLP Rumble (LIVE) https://rumble.com/jesseleepeterson BOND Rumble (Archive) https://rumble.com/rebuildingtheman Odysee https://odysee.com/@rebuildingtheman:2 BitChute https://bitchute.com/rebuildingtheman SOCIAL MEDIA https://facebook.com/rebuildingtheman https://instagram.com/rebuildingtheman https://twitter.com/jlptalk DISCORD https://discord.gg/TB9scyxBpR

keyboard_arrow_left

Tim Pool

Alex Jones Show

Bannons War Room

Trump

navigate_next