Transcribe your podcast
[00:00:00]

Welcome to the Huberman Lab podcast, where we discuss science and science based tools for everyday life. I'm Andrew Huberman, and I'm a professor of neurobiology and ophthalmology at Stanford School of Medicine. My guest today is Dr. E. Jichelnisky. Dr. E. J. Chichelnisky is a professor of neurosurgery, ophthalmology and neuroscience at Stanford University. He is one of the world's leading researchers, trying to understand how we see the world around us, that is, how visual perception occurs, and then applying that information directly to the design of neural prostheses, literally robotic eyes that can allow blind people to see. Once again, today's discussion is a very important one for anyone who wants to understand how their brain works. Indeed, EJ spells out in very clear terms exactly how the world around us is encoded by the neurons, the nerve cells within our brain, in order to create these elaborate visual images that we essentially see within our minds. And with that understanding, he explains how that can be applied to engineer specific robotic AI and machine learning devices that can allow human brains not only to see once again in the blind, but also to perceive things that typical human brains can't.

[00:01:18]

And indeed, for memory to be enhanced, and for cognition to be enhanced. This is the direction that neuroscience is going. And in the course of today's discussion, we have the opportunity to learn from the world expert in these topics, where the science is now and where it is headed. During today's discussion, we also get heavily into the topic of how to select one's professional and personal path. And indeed, you'll learn from Dr. Chichelnisky that he has a somewhat unusual path, both into science and through science. So for those of you that believe that everyone that's highly accomplished in their career always knew exactly what they wanted to do at every stage, you will soon learn that that is absolutely not the case with EJ. He describes wandering through three different graduate programs, taking several years off from school in order to dance. Yes, you heard that correctly. To dance. And how that wandering, and indeed dancing, helped him decide exactly what he wanted to do with his professional life, and exactly what specific problems to try and tackle in the realm of neuroscience and medicine. It's a discussion that I'm certain that everybody scientist or know, young or old, can benefit from and can apply the specific tools that EJ describes in their own life and pursuits.

[00:02:31]

Before we begin, I'd like to emphasize that this podcast is separate from my teaching and research roles at Stanford. It is, however, part of my desire and effort to bring zero cost to consumer information about science and science related tools to the general public. In keeping with that theme, I'd like to thank the sponsors of today's podcast. Our first sponsor is eight sleep. Eight sleep makes smart mattress covers with cooling, heating and sleep tracking capacity. Now, I've spoken many times before on this and other podcasts about the fact that sleep is the foundation of mental health, physical health and performance. Now, one of the key aspects to getting a great night's sleep is to control the temperature of your sleeping environment. And that's because in order to fall and stay deeply asleep, your body temperature actually has to drop by about one to three degrees. And in order to wake up in the morning feeling refreshed, your body temperature actually has to increase by about one to three degrees. Eight sleep makes it extremely easy to control the temperature of your sleeping environment at the beginning, middle, and throughout the night and when you wake up in the morning.

[00:03:25]

I've been sleeping on an eight sleep mattress cover for nearly three years now, and it has dramatically improved my sleep. If you'd like to try eight sleep, you can go to eight sleep Huberman to save $150 off their pod three cover, eight sleep currently ships to the USA, Canada, UK, select countries in the EU, and Australia. Again, that's eight Sleep Huberman today's episode is also brought to us by Roca. Roca makes eyeglasses and sunglasses that are of the absolute highest quality. I've spent a lifetime working on the biology of the visual system, and I can tell you that your visual system has to contend with an enormous number of challenges in order for you to be able to see clearly under different conditions. Roca understands this and designed all of their eyeglasses and sunglasses with the biology of the visual system in mind. Now, Roca eyeglasses and sunglasses were initially developed for use in sport, and as a consequence, you can wear them without them slipping off your face while running or cycling. And they're extremely lightweight. Roca eyeglasses and sunglasses are also designed with a new technology called Float fit, which I really like because it makes their eyeglasses and sunglasses fit perfectly.

[00:04:29]

And they don't move around even when I'm active. So if I'm running and I'm wearing my glasses, they stay on my face most of the time. I don't even remember they're on my face because they're so lightweight. You can also use them while cycling or for other activities. So if you'd like to try Roca glasses, go to Roca. That's Roka.com and enter the code Huberman to save 20% off your first order. Again, that's Roka.com. And enter the code Huberman at checkout. Today's episode is also brought to us by Betterhelp. Betterhelp offers professional therapy with a licensed therapist carried out online. Now, I've been going to therapy for well over 30 years. Initially, I didn't have a choice. It was a condition of being allowed to stay in school. But pretty soon, I realized that therapy is extremely valuable. In fact, I consider doing regular therapy just as important as getting regular exercise, including cardiovascular exercise and resistance training, which, of course, I also do every week. The reason I know therapy is so valuable is that if you can find a therapist with whom you can develop a really good rapport, you not only get terrific support for some of the challenges in your life, but you also can derive tremendous insights from that therapy.

[00:05:35]

Insights that can allow you to better not just your emotional life and your relationship life, but of course, also the relationship to yourself and to your professional life, to all sorts of career goals. In fact, I see therapy as one of the key components for meshing together all aspects of one's life and being able to really direct one's focus and attention toward what really matters. If you'd like to try betterhelp, go to betterhelp.com Huberman to get 10% off your first month. Again, that's betterhelp.com Huberman and now for my discussion with Dr. E. Jichelnisky. Dr. E Jichelnisky, welcome.

[00:06:09]

Good to see you.

[00:06:11]

For the audience, we are friends. We go way back. EJ has been a few years or more ahead of me in the science game. And the best way to describe you and your work, EJ, is you're an astronaut. You go places no one else has been willing to go before. You develop new technologies in order to do that. All with the bold mission of trying to understand how the nervous system, which of course, includes the brain, works, and how to make it better with engineering. So today, we are going to get into all of that. But just to start off and get everybody on the same page, maybe we could just take a moment and talk about the brain and nervous system and what it consists of that allows it to do all the sorts of things that we're going to get into, like see things in our environment and respond to those things in our environment. So, at risk of throwing too much at you right out the gate, what's your one to five minute version of how the brain works?

[00:07:19]

Oh, I don't have a one to five minute version of how the brain works, but I can tell you how I think. Vision is initiated in the brain, and you and I go back a long way, so we have a lot of common understanding about this, but I'll narrate it from scratch, if that makes sense. So, vision is initiated in the retina of the eye, which is a sheet of neural tissue at the rear of the eye that captures the light that is incident on the eye, that comes in through the eye, transforms that light into electrical signals, processes those electrical signals in interesting ways, and changes them up, and then sends that visual information to the brain where it is used to bring about our sense of vision. And you asked me about the one to five minute version, how the brain works. I don't know. But I do know that the brain receives all these patterns of electrical activity coming out of these nerve cells in the retina and somehow assembles that into our visual experience, whether that be responding to things coming at us or our circadian rhythms that govern our sleep and behavior, or identifying objects for prey, or avoiding predators, or appreciating beauty.

[00:08:39]

And what we know is that the brain receives a fantastically complex set of signals from the retina and puts that all together into our visual experience. And we are very visual creatures, obviously. So I think that's a big part of how the brain works, because so much of what we do revolves around vision, revolves around how the brain puts together these signals coming out of the retina. And I would love to understand how that works. At the moment, I don't. And what we're trying to do is get a really complete understanding of how that begins in the retina and then how we can restore it in those who have lost sight.

[00:09:19]

Why focus on this issue in the retina, this thin set of layers of neurons that line the back of the eye? Why explore vision there? I mean, obviously, there are centers within the brain that, of course, contain neurons, nerve cells that are involved in vision, if one wants to understand visual perception, and I agree, by the way, that visual perception is one of the most dominant forces in the quality and experience of our life. Why focus on the retina? Why not focus on the visual cortex or the visual thalamus? What's so special about the retina?

[00:09:56]

Well, we have to focus on all of it, because understanding the retina won't give us a full understanding of how all this works, obviously. And if you don't have your visual cortex and visual thalamus, you won't see. But if you don't have your retina. You also won't see. You won't even have a chance to see. So I focus on the retina because I enjoy the possibility that we can really understand a piece of the nervous system in my lifetime, in our lifetimes, we can understand it so well that we can build it, replace it, restore its function that's farther off in the central regions of the brain. It's going to be quite a bit harder. I find satisfaction in really understanding something so well that I can write down in a mathematical formula what it's doing, that I can test my hypotheses up and down. And, yes, we really get how this little machine works, and that I can engineer devices to replace the function of that circuit when it's lost. That, to me, is just deeply satisfying. But there also is a really fundamental role for people who want to go and do more exploratory work in the visual brain, as you mentioned, in the visual cortex and the thalamus and other places, because ultimately, those retinal signals won't lead to anything if those areas aren't putting it all together to govern our perception and ultimately our behavior.

[00:11:23]

So let's talk about the retina in its full beauty and detail. Three layers of cells that line the back of the eye like a pie crust somehow take light comes into the eye. The lens focuses that light. If it doesn't do that well, we put lenses in front of our eyes, such as contact lenses or spectacles, and somehow takes that light and transforms it, as you said, into neural signals and processes that within the retina. So let's take a deep dive into the retina and do so with the understanding, at least. My understanding is that, in part thanks to your work and the work of others, this is perhaps the best understood piece of the brain.

[00:12:06]

Yes, I think it's a solid argument that it's the best understood piece of the brain, and we'll turn back to that in a minute. So the retina begins with a sheet of cells called the photoreceptor cells that are highly specialized. These are cells that essentially don't exist anywhere else in the brain. And what they do is transform light energy into electrical signals in neurons. Very specialized, very demanding cells. They require a lot of maintenance, and they die relatively easily, which is what gives rise to some of the forms of blindness. Those are the, you might call them pixel detectors. They're tiny cells called photoreceptors that each one captures light from a particular location in the world. That sheet of cells has done that initial transduction process where light is converted into neural signals that the brain can then begin to work with. The second layer is responsible for processing, adjusting, changing, mixing and matching, comparing signals and different neurons. Many complex operations that we're still trying to understand and consists of dozens of distinct cell types that extract features, if you will, of the visual world from the elementary pixels represented in the photoreceptor cells.

[00:13:24]

So that second layer is receiving the input from that sheet of photoreceptors and picking stuff out of it. The third layer of cells is the so called retinal ganglion cells. That's the only term that I'd like to probably will come up repeatedly in this conversation. So for your viewers and listeners, these retinal ganglion cells are the ones who are responsible for taking the signals that are there in the retina and sending them to the brain so that the process of vision can begin. They are the messengers, if you will, from the retina to the brain. The retinal ganglion cells, and there are about 20 different types in humans, are again feature extractors. They pick out different bits and pieces of the visual scene and send interesting stuff to the brain, trying to leave out the uninteresting stuff. And the 20 or so cell types all pick out different types of information from the visual scene. You can sort of think of them as Photoshop filters. Each cell type in the retina, again, about 20 different ganglion cell types. Each type represents the full scene, the entire visual world, but picks out different features. Such as some cells pick out spatial detail, tiny little points of light, almost.

[00:14:37]

Some cells pick out and signal information about things that are moving in the visual world. Some cells pick out information that's been captured about different wavelengths from the photoreceptor cells and thereby giving us our sensations of color and probably more things in those 20 different ganglion cell types that we don't fully understand. The result then is that the retina has this sort of a representation of the visual world, but it has 20 different representations, not one. It's not one picture that comes out of the retina and gets sent to the brain. No, it's 20 different pictures. And you can think of them maybe as 20 different photoshopped pictures, but one of them has the edges highlighted, one of them has the colors highlighted, one of them has movement encoded in it. And somehow these filters send the information to many different targets in the brain. And then our brain puts it all together, and then we have a cohesive sense of the visual world, which is the remarkable feature that we really don't understand.

[00:15:35]

Amazing. Is it fair for those that don't work with Photoshop to think about these different Photoshop filters, perhaps as different movies of the visual world? One movie contains the outlines of objects and people and things. Another movie is showing the motion of blobs in the environment, meaning whatever's moving in the environment is kind of just represented as blobs. Another movie is just the color in the environment. Another movie. And then all of those what I'm calling movies are sent into the brain. And then the brain somehow combines those in ways that allow us to see each other and see cars and objects and recognize faces. Is that one way to say, that's.

[00:16:17]

Exactly how I think about it? Maybe it's a better way to say it.

[00:16:19]

No, I like the Photoshop filter analogy. For those that don't work with Photoshop, I just think that the movie analogy might be a decent alternative.

[00:16:30]

How the retina works is an example. We think of how all sensory systems work. There's an initial representation in a specialized cell type that is responsible for and capable of extracting physical features from the world. And then neural circuits in the brain use that information in different ways to grab stuff out of the visual world. In the auditory system, the sound world is represented also in specialized cells that capture sound energy and transduce that into neural signals. And then subsequent stages of processing in the auditory system pick out different features.

[00:17:10]

Of our auditory world, like the frequency, how high or how low a tone is, the direction it's coming from, right?

[00:17:17]

The movement of it, how loud it is, different features are extracted. So we think the visual system is just an example of how the external world is represented in our brain. And of course, in some sense, a philosophical approach to the brain is really saying, well, there's the sensory world, and then there's the actions we take, and there's almost nothing else that we really know other than those two things, how the sensory world comes in, and then finally it results in our action. That's what our brain is about. Because vision is so important for people. I find it absolutely compelling and fascinating. I mean, as an example, as you know well, many people study rodents to understand how different aspects of the brain work. And rodents are interesting animals and do all sorts of really cool things, but they interact with the world differently than we do in a lot of ways. They sense by smelling, they identify objects by smelling, and they navigate with their whiskers. To a large extent, we don't do any of that. You don't navigate with your whiskers. At least I don't think you do. You don't recognize me when I walk in the room by my smell?

[00:18:28]

No. You use vision for all that. And we humans use vision. So it's a really fundamental aspect of who we are as biological creatures.

[00:18:37]

I wonder if, just for sake of entertainment, we could think about how the human retina, and therefore, vision in our species, differs a little bit from some extreme examples of vision in other species. Not to make this a comparative or zoological exploration, but just to really illustrate the fact that the specific cell types within our retinas create a visual representation of the outside world that can be, and often is very different from that of other species. For instance, or at least my understanding is that the mantis shrimp sees, I don't know, 60 to 100 different variations of each color that we are essentially blind to, because their photoreceptors can detect very subtle differences in red, for instance, long wavelengths of light, what most people refer to as red pit vipers, can sense heat emissions, essentially with their eyes, but also other organs, and on and on. I raise this because I think the human neural retina is such an incredible example of extracting features from the visual world that then we recreate. But I think it's also worth reminding everyone and ourselves that it's not a complete representation of what's out there. Like, there's a lot in light that we don't see because our neural retina just can't turn it into electrical signals.

[00:20:11]

Do you want to give some examples of what we can't see? And if any particular examples from the animal kingdom delight you, feel free to throw those out.

[00:20:19]

Well, one thing you mentioned color. We experience a rich sensation of color when we look at the world and say, wow, I see all these colors. That's immediate, and that's just how we talk about it. But in fact, we have very little information about color. Color is a very high dimensional, complex thing, or wavelength, I should say. Wavelength information really is about how much energy there is in the light around us at different wavelengths. We only have three sort of snapshots of that in our retinas with the three different types of photoreceptor cells that are sensitive to different wavelength, different bands of the wavelength spectrum. Three is not a lot. As you just said. Other creatures have many more ways of capturing wavelength information. And one way you can verify for yourself that we just have three, is to realize that if you look at your TV, there are only three primaries. On your TV, there's a red, there's a green, and there's a blue. That's it. And from those three primaries, the entire richness of the experience on your TV set is composed. So with just those three things, you basically are able to create any human visual sensation.

[00:21:33]

Well, a mantis shrimp would be like, that's nothing. There's so much more stuff out there that's not represented on this TV. If you could speak to the mantis shrimp. Another thing we maybe don't see another example of a difference in the animal kingdom is, so, again, taking rodents as an example, one of the things that rodents have to do is to not be hunted by birds that are coming down toward them. And so it appears that there are cells in the retina that seem to be quite sensitive to looming, to something dark that's getting bigger, like a shadow coming from a bird coming down at you. We don't know for sure that this is exactly what causes animals to avoid being eaten by birds. But there's interesting evidence in that direction. That's not really a big thing for us, for humans, as far as I know, we're not typically hunted by huge birds. So that's not a thing we need. And I think that's where it comes back to where you were headed, if I understand right, which is we occupy different biological niches, we and the manta shrimp and the rodents. And our visual systems reflect that.

[00:22:42]

We have different stuff that we're looking for in our visual environment than other creatures are. And so our eyes are different. And that's one of the reasons that we emphasize work on the human retina, as opposed to certain other animal species that would be less clearly relevant to the visual experience you and I have.

[00:23:01]

So let's talk about these incredible experiments that your laboratory has been doing for several decades now. I've had the privilege of sitting in on some of these experiments, and they are very involved, to say the least. If you could just walk us through one of these experiments, I think the audience would appreciate understanding what goes into, quote, unquote, trying to understand what's going on in the electrical activity of these specific retinal cell types, the retinal ganglion cells, in particular. What does this look like? You're in your laboratory at Stanford, and you get a phone call. Someone says, I got a retina. What happens next?

[00:23:43]

We scramble like crazy. We drop everything we're doing, cancel all our appointments, and get ourselves ready for 48 hours of nonstop work down in the lab, getting as much data as we possibly can from the retina. The most exciting example of what you just said is when we get a human retina, when, for example, there's a donor who has died and the retina is available for research, we jump at that opportunity.

[00:24:06]

How soon after the person is deceased do you need to get the eye globe, the eyeball, in order to get the retina in a condition that will allow you to record electrical signals from it?

[00:24:17]

A few minutes, just you're waiting in the hospital. The way we typically get these eyes is from brain dead individuals. So people who are legally and medically dead, but their hearts are still pumping and therefore their retinas are still alive and functioning when those individuals are used, the bodies of those individuals are used for organ donations. We can benefit from that organ donation setup that organ distribution centers do to save many people's lives and also to promote research. So we sometimes get those retinas, and that begins the experiment for us.

[00:24:56]

I'm going to ask for a few more details here, just to put the picture in people's minds and not to be gruesome. I just really want people to understand what's involved here. So you'll get a call. We've got a patient who is soon to be deceased. They've consented to giving their eye globes, their eyeballs for research so that you can study the human retina. Is it you who goes over and takes the eyes out? Does somebody do that or hand them to you in a bucket of ICE? I'm sorry if I'm making people queasy at all, but this is, folks, how one goes about trying to understand how the human brain works.

[00:25:29]

Absolutely. And this is also how you go about donating your heart so that you can save somebody else's life who needs a heart transplant. The same incredible organizations that do the harvesting of the tissue for us, their primary goal is to do that for organ donations to save lives. They save lives every day. These people are incredible. Donor Network west is one of those organizations, the one that we work with. They're really amazing. So their technicians or a retinal surgeon will take the eye out, give it to myself or somebody from my lab who will bring it back to the lab. And we have a way to keep the eye alive and functioning. Just the eye by itself.

[00:26:04]

Is this always at Stanford or do you sometimes travel elsewhere?

[00:26:07]

Local hospitals up to an hour away.

[00:26:09]

So then you drive them back?

[00:26:11]

We drive them back. It's the retina Express. And when we're bringing back the retina express again, it's all hands on deck in our lab. We are scrambling, setting up all of our equipment getting everything ready. You've been at these experiments. They're intense, and they really are 48 hours marathons of incredible activity by really dedicated individuals. So we might get those eyes. Sometimes I get them at two in the morning. That's common. And from that, two in the morning, time begins the experiment. So we bring the eyes back, we open them up, and we have access to the rear of the eye, which is where the retina is. It's a thin sheet of neural tissue at the back part of the eye. We hemisect the eye, cut it in half so that we can see the back. It's like half of a globe, if you will. And then we put in relaxing cuts and lay it out flat so we can see what we're working with. Then we take little segments of retina out. In the subsequent 48 hours, cut them out, maybe a three by three millimeter piece of the retina, a little chunk of retinal tissue, and bring it into an electrophysiology recording and stimulation apparatus that allows us to interact with it, and we do two types of experiments with that.

[00:27:21]

So this electrophysiological recording and stimulation apparatus is very custom built by our physics collaborators, who have developed high end equipment. It allows us to record and stimulate through 512 channels simultaneously at very high density. This is pretty high end stuff in terms of technology for interrogating and manipulating the electrical signals in the retina. That's what we specialize in, in my lab.

[00:27:46]

Could I just ask a question about this device? I've seen it before. It's very small. As you mentioned. You're recording from a few millimeters square of the retina from this recently deceased patient. It looks a little bit like a bed of nails, right? Like tiny little microwires all arranged very closely to one another. You got the retina laying down on top of it. And that bed of nails can extract, meaning record, the electrical signals that are coming out of the retinal ganglion cells.

[00:28:17]

That's right.

[00:28:18]

And the retina is still alive. So you are in a position to shine light on it and essentially make it behave in the same way it would if it were still lining the back of a healthy, alive person.

[00:28:33]

That is the beauty of these experiments. So because we can keep the retina alive and happy, and because the retinal ganglion cells, the cells that are the ones that message the visual information to the brain, are on the surface, we can put them right next to the electrodes, and we can record their electrical activity. In other words, we record the signal that those cells would have sent to the brain if they were still in the living person. And at the same time, as you said, we can focus an image that we create on a computer display onto the retina. So we're treating the retina, if you will, as a little electronic circuit, which it almost is, honestly delivering light to the photoreceptor cells so that they are electrically excited, and then recording the electrical activity that the retina is sending out, if you will. That allows us to study how the retina works normally. What we also do with that same electrical apparatus is turn around and pass current through those electrodes in order to see if we can activate those ganglion cells directly with no light, just electrodes. Why do we do that? We do that because it allows us to design future methods of restoring vision by electrical stimulation of the retina, which we'll probably talk about in a few minutes.

[00:29:49]

I'd like to take a brief moment and thank one of our sponsors, and that's Ag one. Ag one is a vitamin mineral, probiotic drink that also contains adaptogens. I started taking Ag one way back in 2012. The reason I started taking it, and the reason I still take it every day, is that it ensures that I meet all of my quotas for vitamins and minerals, and it ensures that I get enough prebiotic and probiotic to support gut health. Now, gut health is something that over the last ten years, we realized is not just important for the health of our gut, but also for our immune system and for the production of neurotransmitters and neuromodulators, things like dopamine and serotonin. In other words, gut health is critical for proper brain functioning. Now, of course, I strive to consume healthy whole foods for the majority of my nutritional intake every single day. But there are a number of things in ag one, including specific micronutrients that are hard to get from whole foods, or at least in sufficient quantities. So ag one allows me to get the vitamins and minerals that I need, probiotics, prebiotics, the adaptogens, and critical micronutrients.

[00:30:50]

So anytime somebody asks me if they were to take just one supplement, what that supplement should be, I tell them, ag one. Because ag one supports so many different systems within the body that are involved in mental health, physical health, and performance. To try ag one, go to drinkag one. Huberman, and you'll get a year's supply of vitamin D, three K, two, and five free travel packs of ag one. Again, that's drinkag one. Huberman let's take this moment to talk a little bit about cell types. So, you mentioned there are about 20 different types of these retinal ganglion cells, what we may refer to in brief as RGCs. So retinal ganglion cells, RGCs, same thing. And as you mentioned, these cover the entire retina so that if each cell type is extracting a different set of features from the visual word, motion, color specific colors, et cetera, that essentially no location in the world around us fails to be represented by these cells. Put differently, these cells are looking everywhere. Each cell type is. Each cell type is looking everywhere, so that if movement occurs in any region of our visual world, we are in a position to detect it.

[00:32:07]

But maybe we could talk a little bit about cell types. Cell types is such an important theme in the field of neuroscience and indeed, in all of biology, but it's actually not something we have talked about very much on this podcast before, either in solo episodes or in guest episodes. I don't have any specific reason for that. We've talked about brain areas, prefrontal cortex, basal ganglia, anterior mid signal cortex, and on and on. We've talked about neural circuits, but we've never really talked about cell types. So the ganglion cells.

[00:32:35]

Brother, you let me down. No talking about cell types.

[00:32:37]

Well, but that's why you're here.

[00:32:39]

That's why I'm here.

[00:32:39]

That's why you're here. Tell us about cell types. How do you figure out if you have a cell type? How do you know if it's a cell type? Or is it the shape? Is it how it responds? How do you know if you have a cell type? What's this about? And I want to just put in the back of this question, or rather, in the back of people's minds, that this issue of cell types is not just an issue pertinent to the retina. This is an issue that is critical to understanding how the brain works.

[00:33:08]

Absolutely.

[00:33:09]

It's critical to understand consciousness. I know a lot of people like, what is consciousness? Right. We're not going there just yet, but what are cell types? How do you determine if you have a cell type? And why is this so important to understanding how the brain works?

[00:33:21]

Yeah, I mean, as you said, as far as we understand, every single brain circuit is full of very distinct cell types. Those cell types are distinguished by their genetic expression, their shapes and sizes, which other cells they do contact and which cells they don't contact, where they send their information to in other parts of the brain and what they represent and as far as we know, this is true throughout the brain, and it's true in the retina. The different ganglion cell types. Retinal ganglion cell types, about 20 of them, each of which is looking at the whole visual scene, extracts different stuff. This cell type one extracts one thing, cell type two extracts something else, but they all represent the entire visual scene. But those cell types, we know from lots of beautiful work, work that you're closely connected to and some of which you've done. Those cell types have different morphology, different shapes and sizes, different patterns of gene expression, different targets in the brain. They send their outputs to different places in the brain. So, really, to study the retina without understanding cell types, you're kind of lost right away. You have to know what's going on with the cell types.

[00:34:30]

Otherwise, you can't make sense of this retinal signal. The way we identify them in two ways and for different purposes, the basic way we identify the different cell types is their function, because we study their function. We study how they respond to light images, and we can clearly separate them out. And, in fact, it's a simple thing to say, but it's really true. Our 512 electrode array technology, which you've seen in our lab and stuff that we developed with collaborators about 20 years ago, was crucial for this, because with that 512 electrode technology, we could see many cells of each type, and we could clearly parse them apart from one another, whereas previous studies working on one cell at a time had great difficulty doing that. So with our technology, with 512 electrodes, we record hundreds of cells simultaneously. We can say, oh, there's 20 of these, there's 50 of those, there's 26 of those, and here they are. And we can just set them in different bins and say, okay, this is what's present in this retina, just what the information is they're extracting. There's another purpose, again, referring forward to the neuroengineering aspect.

[00:35:34]

We need to identify the cell types not just based on what visual information they carry, but based on their electrical features, properties. Electrical properties of the cells. Cells. As you know, neurons are electrical cells. They fundamentally receive and transmit electrical information. And the way that they do that has a distinctive electrical signature that turns out to be super important for developing devices to restore vision.

[00:36:00]

Could you explain how you determine what a given cell type does, its electrical properties? Let's just draw a mental image for people. The retina is taken out of this deceased individual, put down on this bed of nails, of electrodes. Those electrodes can detect electrical signals within the ganglion cells. You are able to shine light onto the retina and see how the retinal ganglion cells respond. Meaning what electrical signals they would transmit to the brain if they were still connected to a brain. They're not connected to a brain in the experiment. They're sitting there.

[00:36:34]

But they're trying.

[00:36:34]

But they're trying. I could imagine playing those cells, a movie of a checkerboard going where every square on the checkerboard goes from white to black to gray. Could do that. I could play a cartoon. I could show it this year's Academy award winner for best picture. How do you decide what to show the retina? This is a human being's retina, after all. Presumably, it looked at things that are relevant to human beings until that person died. But how do you determine cell type electrical signals if you don't know what specific things to show it? I mean, you're going to show it, I don't know, Disney movies. What do you show it?

[00:37:21]

So what we show now reflects the fact that we've built up a lot of information. And our work stands on the shoulders of many scientists who have studied the retina for decades to figure out what different cell types respond to. And we know that certain cell types respond primarily to increments of light. When light gets brighter than it was, so a change from a certain brightness to a higher brightness. This particular cell type fires. Another cell type fires or sends spikes to the brain when it gets darker. Some cell types respond primarily to large targets in the visual world. Other cell types respond better to small targets in the visual world. Some cell types respond to different wavelengths of light that we can identify. There exists certain cell types that are still poorly understood that respond to movement. So we can tailor visual stimuli to types that we kind of already know about. Because of much preceding research, that's not actually how we do it in our experiments, for the most part. Instead, we use a very unbiased, flickering checkerboard pattern, as it turns out, which is in a really efficient, unbiased way to sample many cells simultaneously, so that in a half hour of electrical recording from a retina, we can figure out what all the 512 or so cells are that we're recording and know all of their types.

[00:38:46]

And the way we do that is to play essentially random garbage, TV snow type image to the retina for a period of time and determine which bits of brightening or darkening or movement or whatever in that random garbage activated this particular cell by looking at average across the half hour recording and saying, oh, it looks like this cell was always firing when it became bright in this region of the screen. That must be an on cell sensitive to light in this region of the screen and so on. So we have sophisticated, efficient ways of doing it. But it all comes back to these basic things about what features in the visual world tend to cause a given cell to send a signal to the brain.

[00:39:28]

Yeah, that makes a lot of sense. So you take essentially what you called random garbage, snow white, black and gray pixels on a screen. The retina views that, and then the cells in the retina will respond every once in a while with an electrical potential. They'll fire, as we say, Spike, it's sometimes called. And then you take sort of a forensic approach a bit later. You look back in time and you say, what was the arrangement of pixels in this random garbage right before this cell fired? An electrical potential. That's right, a spike. And then from that, you can reconstruct the preferred stimulus. You can say, oh, this cell and cells around it seem to like motion of things going in a particular direction, for instance. And how do you know that the cell doesn't also like a bunch of other stuff that you didn't pick up on using this random garbage?

[00:40:37]

Yeah, two things. Let me just say for the record, we don't record from these cells that signal motion in particular directions. They are an elusive cell type that is best understood in rodents and other creatures and not well understood in the primate, as you know, although some people are discovering potential cells of that type now and have recently discovered them.

[00:40:56]

Okay, so let's say cells that respond to small, like spots that are red, that go from dim red to bright red, right? Yeah.

[00:41:07]

So we can go through that colored TV snow and pick out the cells that responded to a transition of the kind you described, from darker to lighter or from greener to redder or something like that. Cells tend to respond to transitions in the visual scene rather than static imagery. And so we can pick that stuff out. But you ask the question, well, gee, is the TV snow going to capture everything about what these cells are doing? That's a really important question that I want to just mention more. Quite likely not. That's a scientific instrument. It's an unbiased way to sample a whole bunch of cells. First cut, look at, generally speaking, what are they up to? But that doesn't mean we've really captured their role in natural visual perception, because actually, you don't go through the world perceiving visual snow. You go through the world perceiving objects and meals and mates and targets and all these things.

[00:42:01]

Right?

[00:42:02]

So the study of how the retina responds to more naturalistic visual stimuli in my lab and in many other labs around the world is really getting off the ground now. And I would say we have limited understanding. I would say we know that our simple laboratory experiments with the TV snow don't capture the whole story. There's more. There are about 20 different cell types in the retina. We have basic characterizations of seven of them, if you count a certain way. We know that there are another 15 or so lurking right behind the curtain that we've started to sample. We don't know what naturalistic targets they respond to in the visual life of the animal. That's work that's underway. Exciting, interesting work, because we know that they got to be there for something. One way to think of it, I'm pretty sure you think of it this way, too, is that the retina is a highly evolved organ with a lot of evolutionary pressure for it to be efficient, to have a small optic nerve sending to the brain. It's probably the case that there's no accidental stuff sitting around in the retina that's vestigial and sending information to the brain.

[00:43:15]

It's probably the case that those signals are all doing something important for our visual behavior, for our well being, for our sleep, all sorts of stuff. And the field is still trying to figure that out. These are the big mysteries, I think, in terms of the retina, what are those signals exactly in all those different cell types, what different behaviors and aspects of our life do they control?

[00:43:39]

What is the wildest cell type you've ever encountered? What did it do? What did it respond to? That's what I mean when I say wildest. Retinal ganglion cells that respond to increasingly red portions of the visual scene or decreasingly green portions of the visual scene. Like, okay, cool. That seems cool. Like, get some around the time of Christmas. That's useful. And it's useful on other days of the year as well. But given that the retina is indeed the best understood piece of the brain and given that you have 20 cell types, 20 isn't 20 million. It seems tractable. Probably gets understanding it in its entirety or understanding them in their entirety. Excuse me, one would like to know, what stuff are we paying attention to at the level of the retina? I mean, are there, like, spiral cells that, like, spiral stuff in the environment? Are there cells it, like emojis? What's going on in there? You spend a lot of time doing this.

[00:44:44]

We do.

[00:44:45]

After all, you give up two nights sleep, which is kind of incredible, by the way. I'll just do a little take a moment here and just say, for a guy that's been doing this for this long, with these sleepless nights, you look pretty good, you look pretty rested.

[00:44:58]

I tend to go home. I go home before the graduate students do.

[00:45:01]

Oh, they stay up.

[00:45:02]

They stay up.

[00:45:02]

I was used to stay up.

[00:45:03]

I used to stay up until my mid forty s. I was in there doing the all nighter type things.

[00:45:08]

Got it.

[00:45:08]

And maybe you can help me figure out my sleep patterns better.

[00:45:11]

Yeah, we can talk about that this episode. We can talk about how to pull all nighters and still survive. Done plenty of those. But yeah, lots at stake here. There's a human retina, meaning a human gave up their eyeballs for this experiment after they died. Of course, you've got many people on this. These sorts of experiments are very expensive, a lot of fancy equipment, a lot of salaries to try and figure this stuff out. This is the chief mission of the National Eye Institute. There's a lot of tax dollars. This is, in my opinion, as important as the space program. Probably more important, in my opinion, restoring vision to the blind, obviously. So what are you finding in there?

[00:45:52]

And we have the privilege of being on the front lines of that, funded by the National Eye Institute and other institutions, to be out there figuring out what's going on in this human retina. I'm with you on that. So I'll tell you how we go about it. These days. There are about seven cell types that we understand pretty well what they're doing. They're not complicated, they just have different properties, color, size, this kind of thing, temporal properties, their timing of their signals. And those seven cell types we understand pretty well. But we're trying to really nail down the details. Why? Because of neuroengineering for vision restoration. Then there's another, I'm going to say 15 or so. And the anatomists, the people who study the shapes and sizes of the cells, have long known that there were more cell types lurking in the retinal circuitry, but their function has not been known. And because we didn't have many recordings from them, we didn't have electrical recordings in response to light that would tell us what they naturally do. We've actually had a breakthrough in the last few years, led by a senior researcher in my lab named Alexandra Kling, who has figured out that there's another 15 or so cell types lurking in those recordings, that if we look more carefully they're there and they have crazy properties.

[00:47:06]

And so the crazy properties I can tell you about have to do with the spatial region of the visual world that they respond to. The well known cell types that you know and I know from the textbooks kind of respond to a circular spot in the visual world. If there's light in this little circular area, they'll fire a spike. If there's no light there, they don't care. Well, okay, some cells is not quite circular. Some cells respond to the light that's there and the difference from the light that's around it. So if it's brighter than the light that's nearby, then you get a big response. The new cell types are more puzzling than that. Some of them respond to three or four blobs in the visual world. That's kind of strange. Unexpected, definitely unexpected, based on the textbooks. And the newest ones are weirder yet. Some of them, their visual response profiles, that is, the region of the visual world that they are sensitive to light in almost has a spidery shape, almost like the dendrites of a cell, like the processes of a cell. And some of them have blobby light sensitivity. They're sensitive to light increments here and decrements there and increments here and decrements there, and some blue light over here and blue light over here.

[00:48:21]

We don't understand these cells. To be clear, the seven that we understand reasonably well are not trying to just pin down and really nail for vision restoration the sort of first cut at cell type specific vision restoration. Those ones don't have these weird properties. They're a little simpler to understand. But we're just working out all the details of the timing of the responses and all that. These new ones, we don't know what's going on with them, so we're doing experiments. Those seven cell types constitute maybe 70% of all the neurons that send visual information from the eye to the brain. So we think it's a really solid target for vision restoration to work with the simple ones. When I say that I think that the retina is the best understood circuit in the nervous system. I'm talking about those seven cell types, which we know a lot about what they do, we really do know a lot. It's not done, but we know a lot. I'm not talking about the other 15 cell types, which are a minority of the population, but seem to be doing very strange and surprising things that are yet to be determined.

[00:49:19]

So it's a mix. We know some really good stuff and then there's really some deep mysteries out there about these other cell types.

[00:49:27]

So we've been talking a lot about how to understand the signals that the retina is sending the brain. And I know your lab has done incredible work in this arena and figured out a number of the different signals, as you described, some of the features that the different cell types are extracting just a moment ago, these blobs of different colors, et cetera. What good is this to the everyday person, right? In addition to wanting to understand how we see, what sort of sorts of medical applications can this provide in terms of potentially restoring vision to the blind? But perhaps even larger theme is this notion of neuroengineering, right. Taking this information and creating devices that can help us help our nervous system function better, maybe even function at supra physiological levels. I know there's a lot of interest in this these days, in part due to neural link, right. Because Elon's out there, front facing, very vocal about his vision of the, no pun intended, of chips being implanted in people's brains that would allow them to be in conversation with 100 people at the same time, just by hearing those voices in the head, maybe filtering things out so it doesn't sound like a clamor of 100 different voices, perhaps giving people super memory.

[00:50:50]

Sky's the limit. No one really knows where this is all headed. You're working in what we call a very constrained system where it has specific properties that you're trying to understand. And once you understand those, you can start to think about real applications of what's possible. Like, could you create a visual system that can extract more color features from the world that no other human can see? Can you restore pattern vision to somebody who is essentially blind independent, on a cane or a dog or, God forbid, can't even leave their house because they can't see anything at all? Where is this headed? What is the information useful for? And perhaps we should frame that first within the medical, rehabilitative context of repairing or restoring vision, rather, and then get into the more kind of Sci-Fi type neuroengineering stuff.

[00:51:40]

Absolutely. Yeah. This really is my passion these days. Turning that corner, continuing to figure out the mysteries in the retina, but also saying, wait a second, we actually know quite a lot about this. Shouldn't this be the first place that we can solve problems like restoring vision, restoring function, or augmenting our function? I think it should be. The concept of how to do this is straightforward and not invented by us in any way. And that is the following one of the major sources of blindness in the western world is loss of the photoreceptor cells that capture light. Macular degeneration and retinitis pigmentosa are two well known ailments that give rise to vision loss. And the vision loss is because the cells that capture light in the first place that we talked about earlier die off. So you're no longer sensitive to light, and then you're blind. The concept is that you may be able to bypass those early sections of the retina that capture the light and process the signals and instead build an electronic implant that connects up directly to the retinal ganglion cells. And this electronic implant would do the following. It would capture the light using a camera, which is relatively easy.

[00:52:59]

It would process the visual information in a manner similar to the way that the retina normally does, as similar as possible. And then it would electrically activate the retinal ganglion cells by passing current and causing the ganglion cells to fire spikes and send those spikes to the brain. And if we do this really well, we can essentially replace those first two layers of the retina and piggyback onto the third layer and say, okay, we're just jumping right into that third layer. We're going to force those ganglion cells to send reasonable visual signals to the brain, and then the brain is going to think it got a natural visual signal and proceed accordingly. That's the concept. This is not our idea. People have had this concept for decades, and some people have even started to make it work in human patients. And what I mean by that is implanting electrodes on the retina, stimulating and causing people who have been profoundly blind for decades to see visual sensations, blobs and streaks of light in their visual world that are reproducible.

[00:53:56]

So that's happening now.

[00:53:57]

That's happened.

[00:53:58]

People who were at once blind are able to see objects, are able to.

[00:54:04]

See crude blobs and flashes of light.

[00:54:07]

In ways that allow them to navigate their world a little bit, avoid a.

[00:54:11]

Coffee table, maybe, or at least see a bright window in a dark wall and be able to point to that bright window or the bright doorway in a dark wall, something like that. So it's a glass half full, half empty story that I'd like to turn attention to in this conversation, because I think it's very exciting. Yes, you can see stuff by artificially electrically stimulating the ganglion cells, and you can see stuff that actually helps you interact with your world a tiny little bit. So great. That's the glass half full. The glass half empty is it's nothing remotely resembling what we understand as naturalistic vision, where we see fine spatial detail and color and objects and can navigate complex environments and all that stuff. No chance. You can't do anything remotely like that. You can see that there's a bright doorway over that way and turn toward it, which is a helpful step in your human experience. But there's a long way to go. So the question is, why does this existing technology fail to give us high quality vision? What's needed to give us high quality vision? And this is the piece I'm really passionate about.

[00:55:22]

It turns out that the devices that have been implanted in humans so far by pioneering bioengineers who did really hard stuff were fairly simple devices that treated the retina as if it's a camera that is just a grid of pixels. And they put a grid of electrodes down there, and they stimulated it, according to the pixels in the visual world, and thought, well, hopefully that will cause the retina to do the right thing and send a nice visual piece of visual information to the brain and initiate vision. Unfortunately, they left the science on the table, and this is actually what I'm dedicating the next phase of my career to, bringing the science that we know, that we talked about to the table for vision engineering, and in particular, the fact that there really are 20 or so distinct cell types, and they send different types of visual information to the different targets in the brain. I like to think of them a little bit as an orchestra playing a symphony. Each different cell type has its particular score. The violins do one thing, the obos do something else. It's a very organized signal coming out of the retina, presenting to the brain this complex pattern of electrical activity that the brain assembles into our visual experience.

[00:56:37]

Well, current retinal implants, unfortunately, are too crude to do anything like that. The conductor has just scattered the sheet music everywhere, and people are playing whatever. It's cacophony. Okay, you can maybe recognize a tune in there a little bit, sometimes navigate toward a doorway, but you're not going to get the full richness of the experience by ignoring the different cell types. And I'm so passionate about this, in part for reasons that a little bit are similar to your reasons for doing this kind of work that you do, which I think is great, which is, I feel we have a mission to give back as scientists to take all this stuff we've been talking about, because we find it so interesting and cool and to deliver something to the society that has allowed us to explore these fascinating areas. And in our case, in the case of my lab and what we've done is to turn around and say, wait a second, we understand that there's these different cell types. We understand a lot about what they do. None of this information appears in current epiretal retinal implants. Can't we do better by using the science to restore vision in a way that respects the circuitry of the Retina?

[00:57:48]

That's what we're trying to do. And the mismatch is intense. I told you when we were chatting before that nothing that we have learned about the retina since the founding of the National Eye Institute in 1968 is incorporated into the existing retinal implants. Nothing. We've learned a ton about the retina. Your research was funded by the National Eye Institute. My research is funded by National Institute, a fantastic organization that allows us to learn all these things. How is this showing up in the neuroengineering to restore vision to people? Well, currently it's not. And so we're trying to do that now. Doing that turns out to be hard, and maybe we'll talk about that. It's a technological feat that's really challenging. You have to build a device that you can implant in a human that can recognize the distinct cell types, see where they are, stimulate them separately from one another, and conduct this orchestra to create a musical score that reasonably closely resembles the natural one. That's what we're all about doing, and as it turns out, and maybe we'll talk about that separately. That mission of being able to restore the patterns of activity that the retina normally creates also has extremely exciting spinoffs in three directions.

[00:59:12]

One of them is understanding better how the brain puts the signals together. That's research for the brain. The second one is augmenting vision, creating novel types of visual sensations that weren't possible before, and maybe doing something along the elon musk lines of delivering more visual information than was ever possible. And third, figuring out how to interface to the brain more broadly, because, as you and I know, the structure of the retina is very much representative of the structure of many brain areas. And if we're going to figure out how to interface to the visual cortex, we darn well better figure out how to interface to the retina first. That's what we're all about doing in my lab these days, is figuring out how to do that. Well, that's a mixed science and engineering effort. We've done about 15 years of basic science on that. How do we stimulate cells? How do we recognize cells. How are we going to build a device that does all this and talks to the cells in this way? And I can go into lots of gory detail about it, but that's what we've been doing the basic research on in the last few years.

[01:00:12]

We've worked at Stanford with fantastic engineers from various disciplines, electrical engineers, material scientists, others, to figure out how to put together the pieces and build an implant that can do this in a living human.

[01:00:25]

So is the idea to build a robotic retina, to build, essentially an artificial retina that could be put into the eye of a blind person or even put into the eye of a sighted person, that would fundamentally change their ability to see, or in the latter case, enhance their ability to extract things from the visual world that they would otherwise not be able to see, like seeing twice as far, getting hawk like resolution of the visual world, which that would be cool, could be distracting. I'm not sure I want to see the fine movements of a piece of paper in somebody's notebook from across a cafe as they flutter the pages.

[01:01:07]

But you might want to for a moment, there might be a moment when you want to. And if you have an electronic device that you can control, that you can dial in to sense different aspects of the visual world, by your choice, you might be like, yeah, that's pretty cool. I want to be able to do that right now. There's an example I like to give, which I think maybe is helpful for interpreting what we're talking about when we say being able to do more things with the optic nerve. You gave the example of many voices and stuff. Here's an example that I like. We know that we can drive down the road and have a phone call hands free and do that quite safely. Pretty safely. Right. And why? Because you're tapping in. You've got two types of signals coming into your brain, your visual signal of the cars on the freeway, any one of which could kill you in an instant. So it's important. And the sound coming into your ears, which carries the voice of your girlfriend, who's telling you something that you're interested in hearing. And these are different parts of the brain processing this information.

[01:02:08]

And so you can do both of these things at the same time because there's no interference. One part of the brain's working doing one thing, another part's doing something else. You're good. What you can't do is to read your texts and drive down the freeway at the same time. That's not good, because now that visual system of yours that needs to be detecting these fast moving, dangerous objects is being distracted by looking at the text, and you might die and some other people might die with you.

[01:02:30]

I see a lot of people texting and driving.

[01:02:33]

Yeah. That's why I like to point out this example, to remind people, you can't do it well. You can't do it well. You probably talk them.

[01:02:40]

Yeah, it used to be. We'll just take a brief tangent here into this topic. A few years back, there were a lot of news articles, a lot of discussion about texting and driving, a lot of attention to getting people to stop texting and driving. I've seen a few people pulled over for texting and driving before, but I would say texting and driving is rampant. Reading what's on one's phone while driving is rampant. All you have to do is be on the freeway here in Los Angeles, look in the car next to you.

[01:03:10]

Look where they're looking, and people are.

[01:03:13]

Reading and texting while driving. Presumably when they're doing that, they're just using their peripheral vision to detect any kind of motion. And no doubt this has caused the deaths of many people.

[01:03:23]

Yeah. Change lanes, get away from them. And that's just like that other driver. So here's the thing, and I say this a bit tongue in cheek, but it's. It's sort of a real example. It may be that if we harness the different cell types in the retina to deliver different visual information to different cell types, like the image of the text on your screen to a certain cell type that, you know, the so called midget cells, or the motion of the objects in the visual scene, the cars to a different cell type that.

[01:04:00]

You midget cells, by the way, folks, because they're very, very small.

[01:04:03]

Yes. And named by anatomists decades ago. So we carry that nomenclature forward. Sure. And the parasol cells, which are different cells, you can potentially encode the movement of the cars in the parasol cells. And if those two systems are operating independently, which we sort of think they may be from research that you know very well from your extensive studies and vision, maybe we can do those two things safely at the same time. Now, by the way, that's not my research goal, to text and drive at the same time, just to be clear. But it's a very tangible, real world example of if we do really have parallel pathways that can be modulated and controlled independently of one another, this opens the door to streaming all kinds of visual information in parallel into our very high bandwidth visual systems. That wasn't possible during evolution because we didn't have control over the cell types. So I think of that as the world of visual augmentation. And it starts to get interesting. If the different cell types are behaving in an independent way when they transmit visual information to the brain. Now, how are we going to figure that out?

[01:05:08]

Well, we need a device that can stimulate the different cells independently and then study that to see whether people can do this kind of thing right. What's that device? The artificial retina, the same implant I'm telling you about that can restore vision to people because it's an electronic device that can dial up and the activity in the different cell types. That same device is what we can use as a research instrument to understand if the different pathways are parallel, if the signals interact with one another and explore how the brain receives that information, and then we can use that to explore. Can we augment vision and allow ourselves to have new revisual sensations that we don't even know what that would look like. We don't even understand what it would look like to us to see those sensations, but it might be able to deliver lots of information to our brain. And if we can do all those things, then we can take that same set of tools and engineering technologies into the brain to access different cell types as well.

[01:06:05]

I'd like to just take a quick break and acknowledge one of our sponsors, Inside Tracker. Inside Tracker is a personalized nutrition platform that analyzes data from your blood and DNA to help you better understand your body and help you reach your health goals. Now, I've long been a believer in getting regular blood work done for the simple reason that many of the factors that impact our immediate and long term health can only be addressed, that is, can only be measured with a quality blood test. Now, one issue with many blood tests out there is that you get information back about lipid levels, hormone levels, metabolic factors, et cetera, but you don't know what to do with that information. With Inside Tracker, they make it very easy to understand your levels and what they mean and specific actionable items that you can undertake in order to bring those levels into the ranges that are optimal for you. Inside Tracker also offers inside Tracker Pro, which enables coaches and health professionals to provide premium and personalized services by leveraging inside Tracker's analysis and recommendations with their clients. If you'd like to try inside Tracker, you can go to insidetracker.com huberman and you'll get 20% off any of Inside Tracker's plans.

[01:07:09]

Again, that's Insidetracker.com huberman so to just summarize a little bit of the linear flow here of what you've done, you started off with the understanding that the neural retina is perhaps the best place to try and understand how the brain works because of its arrangement, the cell types, et cetera. You spend a number of decades doing these wild experiments on human retinas and other retinas, recording the different cell types with these high density, what I call bed of nails.

[01:07:40]

Two and a half decades.

[01:07:41]

Not bad, all two and a half decades. It's your robustness that matters, EJ, and you have plenty of it. You figured out what the cell types are. So then you gained an understanding of how light is transformed into different types of electrical signals that encode different features in the visual scene. Then comes the challenge of developing neuroengineering tools to try and stimulate the specific cell types in a way that more or less mimics their normal patterns of activation. Like not activating a huge piece of retina so that the cells that increases in redness are also being stimulated with the cells that edges in a way that would create some schmooey, like, crazy representation of the outside world. That's right. No, you want the same precision that light stimulation of these cells in the intact human eye provides in this explanted retina, this retina on this bed of nails. But then a device that essentially can mimic what the retina does. And you needed to do all that earlier work, understanding, like, what does the normal retina do? What does the healthy retina do in order to try and develop this prosthetic device to either restore vision or.

[01:08:54]

Because it puts you in the position of being able to stimulate cells however you want. In theory, you could create a situation in a human where the cells that respond to, I don't know, outlines of objects are hyperactive so that the person could effectively see objects in one's environment better than anyone else could perceive. I know motion is a tricky one, but motion better than anyone else could see detail in the visual world that no one else could detect. We're not talking about turning people into mantis shrimp, but the analogy works because mantis shrimp can see things that we can't and vice versa. And so what you're talking about here is neural augmentation through the use of engineering.

[01:09:38]

Yes, and we often do talk about it as Sci-Fi because the Sci-Fi writers have been talking. They've been writing about this for decades. It's not Sci-Fi anymore. It's Psi. It's straight up PSi. Right now, it's really, we just need to build the instrumentation and start working with those experiments to figure out how to make it work. I think we have a responsibility to do this because this is the way we take this kind of information. All that's been learned about the visual system by the National Eye Institute since 1968 and all the people that it's funded to do this research and turn the corner and make a difference for humanity with it. And I assume and think that humanity will be leveraging nervous system knowledge to build all sorts of devices that we can interface to the world. Know, I don't know Elon Musk, but I think he's right about that. That that's where we're headed. It should be done well. It's important to do it well. We will hopefully be more connected to truth in the world if we're able to build devices that give us better sensations, more acute understanding of what's going on out there, better abilities to make decisions, and all that, let alone just see stuff.

[01:10:51]

So that frontier of developing technologies to allow our brains and our visual systems initially and then other parts of our brains to do things better is unbelievably exciting. It is Sci-Fi, but I just want to emphasize, I think it's the responsible way to go to think about how to do that. Well, all technologies that we develop can be used for good or for ill. And I'm sure some of your listeners, who are a lot of very passionate thinking people out there thinking about neuroscience and the implications, worry, what does this mean? We're going to be introducing electronic circuits in our brains to do stuff. Yeah. Well, we will. It's pretty much clear that humanity will do that. And so, in any technology development, you have to think about, well, how do you do it? Well, how do you do it for good? There are popular movies right now about technology development, such as understanding the structure of the atom, and that technology development can be used for good or for ill, to blow up cities or to save civilizations. How's it going to go? Well, I think as scientists, we're responsible for advancing that in a thoughtful and meaningful way.

[01:12:04]

I think we can do this in the retina. It is the place to start. I'm curious what you think, actually, as a scientist, because your background is in this field or a very close field to mine. I know you speak with all sorts of scientists on this podcast, but this is pretty much your field, or very close. Not the neuroengineering part, but understanding the retina. I'm curious if you agree that this is the place to start doing this stuff.

[01:12:28]

The first guest to ever ask me a question on this podcast during a guest interview, I think this would be a fun place to both answer and riff on this a little bit, because, first of all, I think the retina is absolutely the place to start, because we understand so much of what it does, what the cell types are, but maybe, by comparison, a different brain region, the hippocampus, which is involved in the formation of memories and other stuff, but formation of memories about what one did the previous day, what one did many years ago, et cetera, is an area that I think anytime the conversation about neuroproshetics or neuroengineering or neural augmentation comes up, people think, oh, wouldn't it be cool to have, like, a little stimulating device in the hippocampus? And then if I want to remember a bunch of information from a page or from a lecture, I can just stimulate, and then, voila, all the information is batched in there. While that's an attractive idea, I think it's worth pointing out right now that, sure, there is a pretty decent understanding of the different cell types in terms of their shapes, some of their electrical properties of the hippocampus.

[01:13:35]

But there is in no way, shape or form the depth of understanding about the hippocampus and what the individual cell types do and what the different layers of it do that one has for the neural retina. So what we're really saying is, if you stimulate the hippocampus, you'll likely get an effect, but it's unclear what the effect is, and it's not clear how to stimulate. That's, to me, the best reason to focus on the retina, because you know what the cell types are. Thanks to the work of your laboratory and many other laboratories, you know what sorts of stimulation matter, and it provides the perfect test bed for this whole business of neuro augmentation, neuroengineering. I think there's also a bigger discussion to just frame this in, which is, so much of what we discuss on this podcast with guests and in solo episodes relates to things like dopamine, neuromodulator, serotonin. Everyone is interested in these things because they can profoundly change the way that we perceive and interact with the world. But one only has to look to the various pharmaceuticals that increase or decrease these neuromodulators and know that, indeed, those pharmaceuticals can be immensely beneficial to certain individuals.

[01:14:39]

I want to be clear about that. But that whatever quote unquote, side effects one sees or lack of effect over time, is because those receptors are, like, everywhere around the brain. So you can't just increase dopamine in the brain and expect to only get one specific desired effect. So the reason you're here today is not because we both worked on the retina, and it's not because we happen to also be friends. It's because, to my mind, your laboratory represents the apex of precision in terms of trying to figure out what a given piece of the brain, in your case, the neural retina, does parse all its different components and then use that knowledge to create a real world technology that can actually tickle and probe and stimulate that piece of the brain in a way that's meaningful, not just, like, sending electrical activity in. And that, to me, is so important. I think if we were going to think about levels of specificity for manipulating the human brain to get an effect, you would say, okay, crudest would be drugs. Take a drug, increases serotonin, which might bind to particular receptors. Take the drug psilocybin.

[01:15:49]

A lot of excitement about psilocybin. We know that can lead to increased connectivity between different brain regions. At rest. There is some demonstrated clinical benefit. There's also some potential hazards, but it's very broad scale. We don't know what's happening when the person is thinking about a piece of moss expanding into an image and a memory of their childhood, or it's like a million different things are happening there. And then at the other far extreme is the kind of experiment that you're talking about, stimulating one known type of retinal cell, seeing what that means for visual processing, or modeling what that means for visual processing, and then building a device that can do exactly that and then maybe ramp it up 20%, 50%, because I think that represents the first step into. Okay, how would you stimulate the hippocampus to create a super memory? Would you stimulate a particular cell type in a particular way? And to my knowledge, despite the immense excitement about the hippocampus, and understandably so, there just isn't that precision of understanding yet. So forgive the long answer, but you asked me a question on this podcast.

[01:16:59]

I love that answer.

[01:17:00]

Long answer, yeah.

[01:17:01]

And specificity is what you're talking about, and we need technology to do that to modulate neural circuits in a highly specific way. We got to start with the piece of the neural circuit we understand best, and we have best access to. That's the retina. It's sitting right there on the surface. We can get right into it and install devices. We know so much about it. That's the place to start, the place that we understand. Build electronics that is adaptive, that senses what circuit it's embedded in and responds appropriately. It's not just electronics. You stick in there and it does something. And that's it. No, it first figures out who it's talking to and then learns to speak the language of the nearby neural circuitry.

[01:17:42]

So a smart device.

[01:17:43]

Smart device.

[01:17:44]

Let's push on that a little bit. So you put a little chip onto the retina that can stimulate specific cell types. Is there a way that it can use AI machine learning, that it can learn something about the tissue it happens to be in contact? Absolutely.

[01:18:00]

In the simplest possible way. The device works in three simple steps. Step number one, record electrical activity, which is what we do in our lab in a room full of equipment. But this is a two millimeter sized chip implanted in your eye. Record the electrical activity. Just recognize what cells are there when they're firing, what electrical properties they have to identify the cells and cell types in this specific circuit, in this human. That's step one. Step two, stimulate and record. So you figure out, oh, this electrode activates cell number 14 with 50% probability. This electrode activates cell number twelve. If you pass a microamp of current with this probability and so on, you make a big table that tells you how these electrodes talk to these cells in your circuit. That's step two, calibrate the stimulation by stimulation and recording. Then finally, when you have a visual image and you want to represent it in the pattern of activity of these cells, you say, okay, I know from decades of basic science what these cells ought to be doing with this image that's coming in. I know exactly what they ought to be doing. That's what the science has been telling us.

[01:19:04]

We've been studying the neural code for decades. To understand this, I know what they should do. Use my device with my calibration, where I know where the cells are, I know how the electrodes talk to them, and bing, bing, bing, bing, bing, activate them in the correct sequence. That's what I think of as a smart device, a device that records, stimulates and records, and then finally stimulates. Yes, AI is part of that. Of course it is, because this is a very complex transformation, if you will, from the external visual world to the patterns of activity of these cells. It's not easy to write down just a few lines of code or a few equations. It's complicated, and AI is really helpful for that. And learning by stimulating and recording and aggregating the information quickly so that you can then use the device. That's absolutely a part of the engineering. Let me be clear. The AI doesn't help us to understand. It's just an engineering tool that helps us to capture what this thing normally does and then go ahead and execute and make it do the thing it should normally do.

[01:20:02]

I hope people will appreciate this example. Perhaps not, but, goodness, I don't know, 40, 50 years ago, but still today. One treatment for depression is electric shock therapy. On the face of it, barbaric treatment, but effective in certain conditions. It's still used for a reason, but it can appear barbaric. Right. People have, like, a bite device, so they don't bite through their tongue or their lips. They're strapped down, and they stimulate all, just like, stimulate all neurons in the brain, essentially. There's a huge dump of neurotransmitters and neuromodulators like drugs.

[01:20:43]

It's completely nonspecific stimulation, effectively, probably even.

[01:20:47]

Less specific than drugs, maybe. And yet the clinical outcomes from electric shock therapy in some cases are pretty impressive. Like people, the brain is, quote, unquote, reset. They still remember who they are, but presumably through the release of neuromodulators like dopamine, serotonin, acetylcholine, in a very nonspecific way, there has been some symptom relief. In some cases, what you're talking about is really the opposite extreme. Before I said pharmaceuticals that tickle a particular neuromodulator pathway would be the opposite extreme. I think electric shock therapy is probably the most extreme. Where is this whole business of neural prosthesis going? Outside of the visual system? Like, right now, I can imagine that there are little stimulators in the spinal cord for sake of restoring movement to paralyzed people. I realize this is not your field, but are you seeing impressive stuff there, or is it still really early days?

[01:21:49]

There's absolutely impressive stuff, particularly, for example, people reading out signals from the motor cortex or the language cortex in order to help people to communicate or to move cursors on screens in order to interact with devices.

[01:22:05]

These are paralyzed people.

[01:22:06]

Yeah. Excuse me. Paralyzed people who can't interact with technology the way that we do, but with their thoughts, can send signals through an electronic device that can be used to control a mouse on a screen and have them connect to the Internet. That's a huge deal, to be able to have people do that. Imagine how life changing it would be to be able to communicate if you couldn't before. So there are wonderful examples of that. You know of them. So do I. The work of Krishna Shinoi and Jamie Henderson at Stanford is one beautiful example over Eddie Chang doing stuff, know, neuralink doing this kind of stuff that built on the work of Shinoi and Henderson and stuff. So that's great. Stimulating in spinal circuits, as you said, for creating rhythmic movements that's happening. So this is an enormous space. And in each case, what you said, I think is really highly relevant. That electroshock therapy, you can think of that as, look, let's say your computer is not behaving right. You can reboot, it might work. Then it'll start not working again. Then you have to reboot it again. Well, how often do you want to reboot your computer?

[01:23:15]

It gets a little inconvenient to be rebooting your computer every five minutes. Maybe you want to go in and actually diagnose this thing and put in a piece of software that fixes the thing that was going wrong instead of rebooting your computer every five minutes. Right. And I think of electric shock therapy a little bit as a reboot. It's at that level. So we want to intervene. More specifically, how do you do that? Well, you have to understand the software in order to do that. You have to have specificity controlling this thing in your computer, not this this or this, this particular thing that's going wrong. You got to interfere with that and change it and modulate it. Well, that's what understanding the neural circuit is about. That's what building specific hardware that can activate specific cells is about. In the case of the retina, again, it's just so obvious that it's right in front of us to do this stuff, and it's right in front of us to take us into augmentation, to giving us better senses. A fun example I like. It's an interesting topic because the National Institutes of Health that funds a lot of research that goes in this direction, tends to not be interested in augmenting our senses.

[01:24:22]

They draw a line, more or less, that's saying, look, we're trying to restore what we were as humans, not create a new kind of human. And that's an interesting question, because I don't think there's an actual line, a bright line between those things. I don't think there's a bright line between those two things. The finest example I know is that even in the very crudeest visual restoration devices, you have to actively suppress the infrared sensitivity of your camera to not have infrared vision. Why? Because many cameras are sensitive to infrared light. So, in other words, if you don't put an infrared filter in front of your camera, you're going to have some infrared vision. Maybe it won't help you very much. Whatever. I'm just trying to say, as soon as you start building devices to restore sensations, building electronic devices, augmentation is right around the corner. It'll creep up on you real fast. So I think you can't even really draw a line.

[01:25:22]

Throughout today's discussion, we've been thinking of the brain as kind of the rest of the brain, I should say, because the neural retina is two pieces of the brain extruded out into the eye globes during development. I like to remind people of that over and over. When you're looking at somebody's eyes, you are looking at two pieces of their brain. There's no debate about that. But most people don't realize that you'll never look at anyone the same way again. But this is the reason why you can tell so much about people's inner state from their eyes. Somebody who's sleep deprived, it's not just about the droopiness of their eyelids or the circles under their eyes. There's an aliveness to the eyes. The yogis talk about people that sort of show up at the level of their eyes as opposed to sunk back into their brain. These are very kind of abstract concepts, but they.

[01:26:11]

And there's some very non abstract stuff these days, looking through the eye, at the retina, the way the ophthalmologists do, and there's a lot of diagnostic capability just in those images of the retina.

[01:26:20]

Oh, right. I'm glad you brought this up. There's some interesting and increasing evidence that looking at the neural retina, because it is a piece of the brain with neurons that have the potential to both thrive or degenerate, that looking at the neural retina, which one can do with these new technologies, can provide a window into whether or not there are forms of degeneration, such as Alzheimer's, and other forms of neurodegeneration deeper within the brain that one can't image directly because of the thick opacity of the skull. So in other words, imaging the eye in order to determine if someone is developing Alzheimer's, because you have a direct.

[01:26:55]

View into a little piece of the brain, it's a good signal. It can help you figure stuff out about what's going on in your brain, even beyond the sunken eyes.

[01:27:03]

Absolutely amazing. So I think the rest of the brain piece is also really interesting. And maybe here we can go like semi neurophilosophical. There are clearly parts of the brain that are involved in essential, what I call housekeeping functions, regulating respiration, keeping us breathing, keeping our heart beating, digestion, responding to threats in some sort of basic way, like through the secretion of adrenaline and giving us the potential to move. But a lot of the brain is capable of plasticity. And one wonders if you were to, for instance, develop a retinal prosthesis that would allow me to see with twice the level of detail that I currently can, would my adult brain be capable of dealing with that information? We're talking about twice as much information coming in same brain tissue on the receiving end. Can it make sense of it? Do we have any idea if it can make sense of it? Are there experiments that speak to that?

[01:28:07]

Yeah, that's a fantastic and interesting question. It makes you think about neural development all over again, right? And I take some inspiration on that from the work of someone you know, Eric Newton, who discovered that there is plasticity beyond the periods of time. He discovered many wonderful things, but there's plasticity well beyond the period of time that we thought that there was plasticity in certain animals, and in particular, that if you make gradual adjustments to the sensory world, you can exhibit plasticity that you can't see if you make an abrupt adjustment. So plasticity is there. It just has to be brought on by more subtle manipulations that take you from A to B in little incremental steps. And if you take those incremental steps, you can see the adult plasticity. So, coming to your question, is the brain capable of receiving the kind of extra information we provided? Could be that if we just show up on day one, bam, try to deliver twice the visual resolution or whatever in your visual system. It could be that if we try to deliver twice the visual resolution on day one, it won't work, it won't look sensible to you.

[01:29:24]

But if we gradually introduce it, by the way that we're dialing up the resolution, we may be able to get there. And there are fascinating studies to be done. You think about spike timing dependent plasticity, a term that your viewers may not all know, but is related to how neurons adjust their strength of connectivity to one another according to the timing of the signals in those cells. Mechanisms like that tell us, wow, the brain really cares about the very precise timing of stuff. And to the degree that that influences the way that neurons do or don't strengthen their connections to one another, it's so fundamental in everything from memory to visual function, what have you.

[01:30:02]

This relates to fire together, wire together, although it highlights the together part. How closely in time do two neurons need to be active in order for them to subsequently increase their connectivity?

[01:30:15]

And indeed, one of them needs to be active a little bit before the other one in order for it to work optimally. Right. So what I envision is that when we have full control of the neural code with an electronic implant that can talk to the cells and do all the things that I said, and we can really control a neural code coming out of the retina, we can then start to play games and dial up that neural code very slowly and teach the remaining brain how to understand these signals. Not introduce some crazy thing from day one. No, just gradually teach. Isn't that how we do everything? Well? Isn't that how plasticity works?

[01:30:50]

I love the subtlety and the rationality of your example, because so much of what we see in the Internet and on the news is like chips inserted into the brain to create super memory or conversations between 50 people at the same time without anyone speaking, just hearing other people's thoughts by way of neural signals being passed from one to the next. But yet another reason why you're here today is because you represent the realistic, grounded, incremental approach to really parsing this whole thing of how the brain works and how one then goes about engineering devices to augment the human brain. And as you just pointed out, it's not going to be done by just sticking electrodes in and stimulating and seeing what happens. In fact, those experiments were done in the 1960s. People like Robert Heath would put electrodes into the brain during neurosurgery, stimulate and just see what the patient would do or what they reported thinking. Nowadays, that's done still, but with a lot more precision and intention, and we've moved far beyond that, by the way.

[01:31:54]

I just want to say, those were important first experiments. Yeah, they're cool.

[01:31:57]

Keith was a rather, let's be honest, not the most savory character. He embarked on some experiments that had a social agenda to them and was, at least by my read, was not the kind of person I'd want to spend time with, to say the least. But you're right, those experiments were critical because, like electric shock therapy, like the formulation of drugs that can massively increase certain neuromodulators or decrease them, they led to some level crude, but some level of understanding about how the brain works, which is what we're really talking about today. But you represent, as I said, the astronauts of this. Astronauts don't go into space and just kind of blast off and see where they end up. There's math, there's physics, there's computer science.

[01:32:44]

Sensors. There's cameras.

[01:32:46]

That's right.

[01:32:46]

Looking where are we about to land here on the moon? Is there a crater here or not? What's around us? We should sense what's there and then make our decisions accordingly. And our electronic implants in the brain, really, we should make them smart. Why make them dumb? We're smarter than that. We can build implants that can sense what's around them and change their patterns of activity accordingly. I use a metaphor sometimes. If you go as an American who doesn't speak Chinese to China and you start yelling in English, maybe somebody will to learn which way to go on the street. Somebody might understand you at some point and help you out, but it's going to be not very effective way to get around. It's way better if you speak the language and you talk to people and ask them where to go. So that's what we need to know. We need to say, look, we have the science. We have incredible devices we can engineer. We have AI. Now that even helps us to do this query of the outside world and turn it into a smarter instrument. Make our instruments smart. Make them so they know how to talk to the brain.

[01:33:50]

Don't expect that the brain is just going to wrap itself around your simple electronic device. No, make a smart device. That's what we want to make a smart rental implant.

[01:34:00]

Maybe we could just take a couple of minutes and talk a little bit about you and some of the things that have led to your choice to go in this direction. So did you always know you wanted to be a neuroscientist from the time you started college? What was your trajectory? I should know this, but you were an undergraduate at Princeton. At Princeton, that right? Studying math. Math. So you could have just done all your work with a piece of paper and a pen, but you had to try and engineer all these electrodes. Okay, that's a pen and paper pen.

[01:34:32]

I took a very random route. I studied math as an undergrad. I spent a few years running around playing music and traveling and living a bohemian life.

[01:34:41]

Tell me more about that.

[01:34:42]

Oh, I basically just told you all I'm going to tell.

[01:34:45]

Following the grateful dead?

[01:34:47]

No, not quite following them. But that was an important part of the story.

[01:34:53]

Was that an important part of your personal development?

[01:34:56]

Yes, very much so. Free expression, dance, music, creative, exploratory music, all that kind of stuff, such a.

[01:35:06]

Contrast to the EJ that comes forward when we're talking about the precision of neural stimulation in specific retinal cell types. But I think it's useful for people to hear both young and old, that one's nervous system can be partitioned into these different abilities to go and dance and travel. And you weren't doing anything academic at that? No.

[01:35:26]

For a few years I wasn't doing that. Programming computers to make a living. And then I started three different PhD programs at Stanford before. No, no, in sequence. I started in the math PhD program. I learned that was not really for me. And I started in an economics PhD program in the business school there. And I realized after less than a year that was not for me. I worked in a startup company for a while. I did a lot of stuff for a few years and it took some settling. But then I decided to go into neuroscience. And there were a couple formative things. One is that I had gotten a really formative experience as an undergraduate from a wonderful guy called Don Reddy, who taught an introductory neuroscience course, who is really inspiring mentor. And then when I was at Stanford, I met Brian Wandell, my PhD advisor, and I was inspired by him. I didn't know why he was studying what he was studying, but I just knew I wanted to learn from this man and I wanted to study with him. I just knew this was the person who should be my manager.

[01:36:31]

Based on something about him.

[01:36:32]

Yes.

[01:36:33]

Can I ask you about these three PhD programs? Because I think people here, or see what you're doing and probably imagine a very linear trajectory. But now I'm hearing you toured around playing music, then you start a PhD program. No. Then another one. No, then another one. Without getting into all the details, I mean, were there nights spent lying awake thinking, like, what am I going to do with my life? Or did you have the sense that you knew you wanted to do something important, you just hadn't found the right fit for you? How much anxiety, on a scale of one to 1010 being total panic, did you experience at the apex of your anxiety in that kind of wondering, am.

[01:37:11]

I allowed to go above ten? Like turning up the amp to eleven?

[01:37:14]

Sure. I just think it's really important for people to hear whether or not they want to be scientists or not. This idea that people that are doing important things in the world, in my view, rarely, if ever understood that that's the thing that they were going to be doing. There was some wandering about that.

[01:37:29]

Sure seems like it, doesn't it? Yeah. I experience the same when I talk to other people, and it seems like that. And for sure, for me, it just took a while of trying different things to see, number one, what I was really good at and where I felt I could make a difference. And I realized I studied math, and I was okay at math. But I have known mathematicians who are really talented, gifted mathematicians, the one who really make a difference. I wasn't going to be one of those people. Likewise, playing music, I don't have that intrinsic talent. It's fun. I can play songs in front of people and do stuff. I like it and stuff like that, but I don't have that kind of talent. In fact, I'll say something that I say to friends sometimes, and you're a good friend of mine. If I had the talent to get a few thousand people on their feet dancing by playing music, I'd probably just do that.

[01:38:22]

Really? As long as we've been friends, I knew none of this. None of this. Mostly because I think we always end up talking about neuroscience or other aspects of our know. I know a great many things about you, but I had no idea. It's so interesting. Do you still do dance? We had Eric Jarvis on the podcast, by the way. Professor at Rockefeller, who studies at one point, was studying speech in birds, as in song in birds. And then he's done a great many other things now in genetics of vocalization, and he actually danced with, or was about to dance with the Alvin Ailey dance company. It's like a really talented. So, you know, dance seems to be like a theme that comes up among the neuroscience guests on this podcast. Do you still dance?

[01:39:14]

Yeah, I love to dance. I'm a free form dancer. I'm not a skilled dancer, but I love music. I love dancing. I think it's part of the human spirit. Someday we'll understand the neuroscience behind dancing. Right. Dancing is a universal human thing in all cultures. What is this dancing thing? Why do we do this and other creatures don't?

[01:39:29]

Well, Jarvis thinks that perhaps it's one of the more early forms of language, and that song came before spoken language. It's sort of interesting that birds that can actually recreate human speech oftentimes have the ability to dance as well. Oh, wow. And so there's some commonality of circuitry there. We'll provide a link to that episode jar.

[01:39:55]

I would love to hear that, but if I may, I'd like to riff on that in a different way. I did spend some time wandering around, as many people do, and I think particularly for your young listeners and viewers who don't know. Wow, could I ever be a scientist and develop new things, stuff like that? Yes, you can. And if you're messing around your life, trying this, trying that, trying the other thing, definitely stick with it. Keep looking for the thing that works for you. I really deeply believe that you got to play around. You got to find what it is that works for you. Interestingly enough, at least it's interesting for me. I spent a lot of years studying the retina in a pure, basic science, just curiosity driven research way, as you and I have both done in the past. And as it turned out, I learned all the stuff I needed to know about the retina to develop a high fidelity adaptive retinal implant of the type that I'm talking about. In that process. The technology, the stimulation, recording, figuring out the cell types. How do you stimulate all this stuff? I learned all that stuff.

[01:41:05]

And I have come to a point in my life where I realize, wow, if somebody's going to do what I think needs to be done, which is to take everything we've learned about the retina and instantiate that in smart technology that can restore vision and do all the things we've been talking about. Who are the people in the world who have the right training and background and know how to do that stuff? I'm one of them. I know that. And it's totally by chance that I picked up and learned. Or it seems by chance that I picked up and learned the things that I need to know for this. But I definitely have the right know how to do this based on all my training and the research that I've done. And it feels accidental. Sometimes I look back on my own history. I'm like, how did I get here? Where this is obviously the thing I need to do. Was this on purpose? It didn't seem like it was on purpose. But now I got to do this because I know what needs to be done. And it's something that needs to be done.

[01:42:01]

So that's my mission for the coming decade or so. Wild.

[01:42:07]

I knew you had this engineer. Mathy geeky neuroscience. I don't want to say geeky, because it may sound like I'm not right there in the same raft with you, but I didn't know about this more free spirited move in all directions depending on what one feels in the moment. Dancing, EJ. It's very cool. Are you still an absolute level eleven coffee snob?

[01:42:32]

Yes.

[01:42:32]

Okay. Yeah. I used to go to meetings. And EJ would bring his own coffee maker and coffee to meetings. We're not talking about an espresso machine. We're talking about extreme levels of coffee snobbery.

[01:42:44]

Press pot, the correct ground coffee, the correct kind of press.

[01:42:47]

Good. I expect nothing less. Proof that not all circuits in the brain are neuroplastic. Nor should they be.

[01:42:54]

That's right.

[01:42:55]

But to bridge off of that in a more serious way, despite the free exploration aspect to yourself and that hopefully other people don't suppress it, seems like you really are good at develop, like, knowing your taste. I think it was the great Marcus Meister, a colleague of ours, who has also worked on the neural retina, extensively, of course, who once said, there's a coding system in the brain that leads to either the perception, the feeling of yum yuck, or meh. And that so much of life is being able to register that in terms of who you interact with and how, and the choices or problems to work on, it seems like you have a very keen sense of like, yes, that. And you move toward that. You've always been very goal directed since the time I've known you, and you've picked such a huge problem, but going about it in such a precise way, hence the analogy to the space mission. So when you experience that, may I ask, does it come about as, like, a thought? Like, oh, yeah, that has to be the thing. Or is it like a whole body sensation?

[01:44:13]

What a great question. I love that question. I have two things to say to that. The first is that for me, it's all feeling. I don't make hardly any decisions out of thoughts. I think, I process. I put it all into the hopper, and the hopper comes out and spits out a feeling. And feeling is like, yeah, that's the thing to do, 100%. And I know not everybody's like me. Lots of people aren't like me, and particularly lots of scientists aren't like me. But I definitely roll that way. That is absolutely how I work. There's something that's related to that that I think is philosophically and in terms of personal development and spiritual development stuff, I think is quite relevant, that I think you'll relate to. My favorite aphorism is know thyself, the oracle. And I think because if you don't know yourself, you can't do anything. You don't even know where to go. You can't even orient yourself at the next thing in your life. And I think it deserves to have two corollaries that go with it, or addenda, know thyself, be thyself. Which is not easy. It's not easy to really be yourself in this world.

[01:45:34]

There are all sorts of things telling us to be something other than what we are. And the third one is love thyself. And, you know, having gone through much exploration of yourself and your life and your values, and me too, and all the things we've talked about over time, that's not easy. Some of us are not necessarily programmed to love ourselves, and it's a skill. And I try my best to be with those three things all the time. Know thyself. Be thyself. Love thyself.

[01:46:10]

Could you elaborate a little bit more on your process for the third? This is a concept that has been very challenging for me and I think for many other people, and it gets kind of opaque when it starts getting conflated with self respect, et cetera. Loving thyself. Do you have practices? Do you meditate? Do you journal? Do you spend time trying to cultivate a love for self?

[01:46:41]

Yeah, I meditate in an informal way in the morning with my coffee. Every morning I make a fantastic cup of coffee and I sit with it, I believe you, for five or ten minutes and take in my world as it's coming toward me and start to. As I come into the day and come into consciousness, I meditate like that. And I have a Ashtanga related yoga practice. Many of your viewers and listeners will know about ashtanga yoga. It's a very physical, spiritual, traditional yoga practice that has a deep, meditative and breath focused component. I know you've had lots of episodes and discussion about the breath and the importance of that for awareness. At the end of many western yoga practices, you end with NAmaste, which is expressing your respect for the connectedness of what is in front of you to the whole universe and what's common to all of us and everything. And I usually practice yoga by myself. And when I say namaste at the end of my yoga practice, a part of that is to myself.

[01:47:49]

Earlier, when I asked you about how you guide your decisions, you said, it's all feel, and you provided a beautiful Description as to how and why that occurs for you and your trust in that. I don't recall you saying whether or not the feeling is in your head or it's a whole body feeling, does it have a particular signature to it that you'd be willing to share? Is it excitement that makes you want to get up and move, or is it a stillness? I think I ask because we've been talking throughout today's episode about the precision of neural coding and these signals that are at the level of individual cells. And yet, when it comes to feeling, we actually have a pretty crude map and certainly a deficit in language to explain what this feeling thing is. And I know that people experience life and feelings differently, but I think it's often insightful when somebody with your understanding of the nervous system and yourself can share a bit. What does it feel like?

[01:48:51]

I love that question. And it relates to something you said to me years ago. What it feels like is ease. And I remember years ago when we were talking about challenging things that each of us was facing in our lives, you said to me something like, I wish for you some ease with all of this. It was very moving, touching. That's what a good friend does, is to give that to somebody who they love. And it sticks with me, probably ten years later. So the feeling I feel when I'm on the path that makes sense for me is ease. It's just, okay, this is it.

[01:49:43]

I love that. I don't actually recall that specific conversation because we had many, many conversations sitting in your yard in San Diego on those plastic chairs with my bulldog Costello, hanging out. By the way, folks, EJ knew Costello, my bulldog, massive, very well. And he was not a huge fan of dogs prior to meeting Costello. But Costello flipped him. He became at least a Costello lover.

[01:50:09]

I love Costello. I'll never forget him.

[01:50:11]

Yeah, he embodied ease. He did nothing but sleep and eat. He embodied energetic efficiency.

[01:50:21]

And everybody loves him. Everybody who gets to be in the same room with him loves him. The people I just spoke to in your setup here, your colleagues. Yeah, I could see why. And you have a beautiful photo of him hanging there.

[01:50:32]

Yeah, he's.

[01:50:34]

What?

[01:50:34]

A creature. Great memory. Definitely embedded in my nervous system. I often choke up when I think about him, but I want to be clear, because I've already cried once about him on a different podcast. I don't want to do that today. They're not tears of sadness. It's this crazy thing. Like, I love him so much, I just kind of want to explode. So, damn it, Costello got me again, and publicly again. So he's someplace laughing. So I love that. And I think, if I may, do you think it's worth kids and adults learning to recognize those kind of states, those signals that tell them they're on the right path by paying attention to. I don't know, like we said, there's sort of a deficit of language. Like, ease is in the body, eases is in the mind. It's the release of. I mean, you know, it's not even worth exploring verbally because it's such a whole body, whole nervous system thing.

[01:51:26]

Yeah. I feel like I actually was thinking about. I was giving advice to a young fellow who is applying to graduate school recently and had a Zoom call with him of that stuff. He had received some good advice from some other people and then I gave him some advice and I saw him speak and emote and with body language drop into like, oh, yeah, that makes sense. Yeah. That feeling. Of course. Kind of the. Of course. And I think if you can teach people to do that, I don't know if the verbal communication of that is going to. Like you said, is that going to do anything? But can you at least observe it in them as a teacher, as a mentor and do things? And when you know, when you've done it because you see them drop into ease, do you think you can detect ease in people by looking at them and seeing their body language and everything?

[01:52:23]

It's got to be an amalgam of different things. The cadence of their breathing, their pupil size. It's not worth dissecting. This is an experiment I would not want to run.

[01:52:32]

Yes.

[01:52:32]

I wouldn't want to bring people into a laboratory and figure out what pupils of the eye dynamics combine with certain rhythms of breathing, relaxation of the shoulders, because.

[01:52:41]

Too beautiful for that.

[01:52:42]

It's too beautiful and it's too nuanced and it's different when we're in motion versus when we're lying down. Science is capable of a great many things, but I don't think needs to be pointed at every aspect of human experience. I think some of these things are simply worth allowing to just be.

[01:53:02]

Do you feel the same way about when you have a feeling about a person? You meet somebody and their energy just captures you. It's like, wow, what a cool person. What amazing energy. Do you want to know the science behind that? I don't.

[01:53:16]

No, I don't. I think the word that comes to mind when I experience somebody like that or something, like a beautiful animal or I see something, the movement of something or a beautiful piece of music or something is the word just behold. I just want to stop and take in as much of it as possible.

[01:53:34]

And here's something I know you've done, but I'm checking to make sure I really got this right because I've done it, too. Because we sometimes get human retinas for doing our experiments. The first thing that happens when we get the human retina, we bring it back to our lab. It's a big production. Everybody's getting ready to go. A whole bunch of moving parts going on. We have to open up the eye and look into it to see what condition it's in. And it's typically with a dissecting scope on a chair. It's open. Sitting on a chair, dissecting scope, looking down, look into the eye. It is so beautiful. It's breathtaking. Each time I've looked at the retina, I don't know how many times each time. Wow. This is what's initiating all the visual experiences I've ever had in my life, or that person ever had in their life. Right? And the beauty just keeps coming.

[01:54:25]

I love it. And I love it because you're talking about a behold moment that isn't just to entertain your curiosity. Sure, it's that you want to understand how the brain works, but also a behold moment that leads from that desire to understand to a deep level of understanding. Now, after more than two decades of exploration, to a mission and service to humanity, restore vision to the blind, develop neuroprosis and other types of neuroengineering technologies that will allow the human brain to function better than it would otherwise. So there's real purpose there too. It represents kind of a perfect ecosystem of. It's not just about delighting in something and spending one's time there. There's a real mission there. I love it. Well, EJ, Dr. Chichelnisky, Dr. Huberman, I rarely get called that these days. When I invited you here today, I was absolutely sure that our listeners and viewers were going to get an absolutely world class explanation of how the nervous system works, and the retina and the visual system in particular, and that it would be delivered with the utmost clarity, which it was. So thank you. I know there's been so much learning in and around that, and you beautifully framed for us what that means in terms of the larger understanding of how the nervous system works and what you and other laboratories are now in a position to really do with that information and the technologies that are being built and that will be built.

[01:56:07]

And the purpose in bringing you here today was just that, but not that alone. I think we hear so much about the brain and how it works, and everyone wants to have tools and protocols to function better, but it's clear that the work that you're doing is headed in a direction that's going to vastly expand the possibilities for sake of treating human disease and for expanding human experience. I'm certain of that. What I did not expect, however, was that when I wrote down one bullet point, well, actually two I wrote still a coffee snob question mark. The answer is yes. And yoga. That we would end up in territory where you would share some of your experience that I myself was not aware of. About this a bit of a wandering of three different PhD programs and of this cultivation of an intuitive sense of beauty and taste and preference that the way you described it takes you out of your rational mind and into the aspects of your nervous system that just really act as a compass toward what is absolutely right for you. And we're all so lucky that what's absolutely right for you turns out to also be what's absolutely right and beneficial for the world.

[01:57:30]

So thank you for coming here today. Thank you for sharing your knowledge and your heart and for doing it with such an incredible degree of openness and respect. So thank you so much.

[01:57:46]

Thank you, Andrew. It's a great pleasure. Really appreciate it.

[01:57:49]

Thank you for joining me for today's discussion with Dr. EJ Chichelnisky. To learn more about the work in the Chichelnisky lab and to find links to EJ's social media handles, please see the links in the show. Note Captions if you're learning from and or enjoying this podcast, please subscribe to our YouTube channel. That's a terrific, zero cost way to support us. In addition, please subscribe to the podcast on both Spotify and Apple. And on both Spotify and Apple. You can leave us up to a five star review. Please check out the sponsors mentioned at the beginning and throughout today's episode. That's the best way to support this podcast. If you have questions for me or comments about the podcast or guests you'd like me to consider or topics you'd like me to consider for the Huberman Lab podcast, please put those in the comments section on YouTube. I do read all the comments, not during today's episode, but on many previous episodes of the Huberman Lab podcast, we discuss supplements. While supplements aren't necessary for everybody, many people derive tremendous benefit from them for things like improving sleep, for hormone support, and for improving focus.

[01:58:46]

To learn more about the supplements discussed on the Huberman Lab podcast, go to live. Momentous, spelled o U S. So it's livemomentous.com slash Huberman. If you're not already following me on social media, I'm Hubermanlab. On all social media platforms, that's Instagram X, Twitter, LinkedIn, Facebook, and threads. And at all of those places, I discuss science and science related tools, some of which overlap with the content of the Huberman Lab podcast, but much of which are distinct from the content of the Huberman Lab podcast. So again, it's Huberman Lab on all social media channels. If you haven't already subscribed to our neural network newsletter, the neural network newsletter is our zero cost monthly newsletter that has podcast summaries and protocols in the form of brief one to three page PDFs that spell out for you in very clear terms how, for instance, to optimize your physical health, how to optimize dopamine, how to improve your sleep, how to learn better through neuroplasticity, deliberate cold exposure, heat exposure, and on and on again, all completely zero cost. To sign up for the neural network newsletter, you simply go to hubermanlab.com, go to the menu tab, scroll down to newsletter and enter your email.

[01:59:50]

We do not share your email with anybody. Thank you once again for joining me for today's discussion with Dr. E. J. Chicholnisky. And last but certainly not least, thank you for your interest in science. Close.