[Audio problems]253  Propositions Concerning Digital Minds and Society 2

hello and welcome to session 253 in the
AI sector.com reading group
tonight we'll be discussing the second
half of propositions concerning digital
minds and Society by Nick Bostrom and
Carl Schulman
can I do something with this
wind for some reason the window seems
stuck on Chris
oh well there I think it's good enough
okay great
um so in the future uh this is work by
the future of humanity Institute where
Nick Bostrom is the director and Karl
German one of the researchers
um
and we're of course reading the second
half uh today and uh since we read the
first part Nick Bostrom has actually
commented on a list wrong for the first
time in like 14 years
um to clarify a few things about this in
particular he is saying that this is the
wreckage of an abandoned Book Project
between Carl Schulman and Nick Bostrom
and that possibly explains and he goes
into details also about some of my
thoughts about whether this is only
relevant for a very narrow subset of
futures
um
and why he thinks that's still valuable
um so I I that was of course good to see
but also he's saying that it's because
other priorities have become more
important and I'm really looking forward
to seeing what that those are
so the first part of the second half is
about AI empowered social organization
and we start out actually not with the
social entity being humans but the
social entity being AIS AIS of course uh
could be easily imagine to be able to
coordinate a lot in that you can
literally copy agents and that will give
us a lot of predictability in
um in their motivation and also
uniformity
um this bathroom once is only for
non-indexical goals and for the people
who don't know what that is it refers to
things like who you are where you are
under the current time I now in here
um like
um
I think it's unlikely we're going to
build a lot of AIS that strongly care
about themselves or like strongly care
about the place they are like obviously
if the United States is going to build a
robot AI or something like that then
they would want that to be on the side
of the United States not the size of the
country that they're currently in
because if the soldier moves to China
then they wanted to not care about China
but still care about the United States
right I think index local goals are
quite unlikely
um
also I would say that just because you
get predictability in uh in motivation
doesn't mean that you get very much of
predictability in um the actual um
execution uh because it's going to be
finding itself in different uh
situations
doesn't talk about uh how AIS will
coordinate about not selling their own
IP and what do you do if an a AI does
something wrong you can't really punish
it so you might want to Target the goals
or the creators of the AI whether it's
an advantage of not caring about
yourself in war that could be plausible
and it will eventually become possible
for principal to have highly aligned
agents and that's of course true with
under the assumption that you actually
solve the alignment problem which seems
to be the key unexplored
um uh background Assumption of uh this
world
current Communications protocols uh
could be coordination protocols sorry
could be undermined by AI by collusion
or deception that's the point many
people have made and it's really
interesting and uh I think in particular
this is the thing that could happen
before we get really strong AGI we we
could see things like captures being
broken in general
um Ernie Davis has a concept of info
apocalypse and the sooner this can
happen the uh the more dramatically uh
the implications could be
and the more we could do in advance
about this
question and children have a a nice
analysis that's based on levels of
coordination and the two levels they
mentioned are states at the high level
and at the lower levels corporations
and also criminal Enterprises and things
like that
um I think in fact this analysis is
really good and something that could be
expanded because there are obviously
more than two levels in society it would
be easy to have an individual level and
then something like corporations and
some something like States and then
Supernatural at the highest
national at the highest level
and one of the insights they have is
that strong coordination at one level
could reduce coordination at the other
levels so if you have a really strong
State uh that would mean that the uh
um the coordination and in particular
the power at corporate level might uh be
lower and reverse so these four levels
are to some extent in contrast to each
other
we could see things like criminal
conspiracies become easier or harder
um we could see uh more partisan things
logging in
um we organizations should probably be
expected to be more effective because we
don't have so much of the principal
aging problem
um we have 3D Parts on the state level
and Supernatural level that could be
very interesting and could also happen
at lower levels we could see despots
being immune to overthrow and thus more
likely to go to war perhaps
but we could also see uh some more
preventing organizations like the United
Nations become stronger
um
and there are indeed suggesting that um
some super organizations may even be
robust to the actions of states
so I think it's really interesting to to
look at these four levels and try to
predict which of these are going to be
stronger by AI coordination
right now my intuition of these four
levels is that there is a lot of power
on the state level but AI technology is
mostly held in large corporations that
are subject to state power but do in
fact have a lot of power themselves and
so that would be another expectations
individual humans would be in my
analysis more likely to miss out on the
same a single human can't really benefit
from coordination and of course can have
better epistemics but there's much less
looking from a better AI foreign
individual fuels than for uh like a
state unfortunately
3D Bots uh was something we talked very
briefly about uh last time the idea that
you can have two parties that work
together on building and
um
an artificial intelligence that acts as
an enforce of some kind of tree treaty
and is able to adjudicate uh in in very
complex situations
um hope perhaps built by the strongest
built by the least intellectual capable
Ai and verified by the strongest
um to make it hard to make it harder to
have uh like back doors in the 3D Parts
those would make more deals possible
um and make enforcement easier but there
might be bargaining problems that this
doesn't solve and I think that's very
likely and um but we could also see this
combined this would make it easier from
an epistemic level to
solve problems that are related to bias
or poor reasoning because you just
Outsource that to the 3D part
you could make the 3D part immune to
extortion and things like that that
would be really nice but the thing
that's somewhat missing here in my mind
in this analysis is the idea that AIS
can merge like good old-fashioned AI can
you know merge by just adding the
resulting functions to its own factor
and I think that's probably also
something that's going to be possible
for um
AIS without an explicit utility function
if two depends on depending on how much
they know about their reward function
but I think that sounds very likely and
that is something I expect to have a
dramatic real life effect where I expect
3D parts to be very unlikely to be
something that happens
next part is about satisfying multiple
values which is something we currently
in the world are not doing a great job
of but it's possible that digital Minds
would in fact do better
so the key thing that uh pastram is
talking about here is a distribution of
resources between AIS and humans
existing humans where the AIS might in
fact have uh be either super
beneficiaries or super patients
to consider three possible policies the
first assigns 100 of resources to humans
and none to AIS the second assigns is
all to Super beneficiaries that will be
super intelligence's impacts and the
last assigns uh one in a thousand one in
ten thousand to
um uh to humans and the rest to to AI
if we have to choose between policies
and if in fact there is a policy that
aside that increases the probability of
outcome C but decreases the probability
of A and B then person has a long list
of reasons why we would in fact want to
follow that policy and I have to ask
very electronically if because it is not
clear to me that that such actions exist
and I can't immediately find out uh
consider any that would really work for
that
um so I think that's
um
uh like uh it's uh no good to just
suggest this would be nice without any
concrete idea about how you would go
about this second Davis has written a
comment on this uh maybe or even a reply
on this wrong and where he adds that if
you substitute paper clips instead of
super beneficiaries then the analysis
works almost as well
now only getting one in ten thousand
sounds really bad but we need to
remember that the cosmic endowment is
really large and we could in fact see
dramatically increased uh resources
um and uh uh token uh utilitarianism
holds that it matters how how much is
created or how long time how much
children your tools is created and in
fact that is only something that matters
for like far away galaxies in the
distant future and I think in fact
really really far away galaxies in the
really really distant future would be
all that is required for this except for
practical uh purposes
and finally Pastor suggests we should
promote cooperation and compromise over
conflict in development deployment and
among AIS and that's the kind of thing
that sounds really nice and uh you know
feel good and also not practical at all
like without any concrete action to
point at like how do we in fact make
sure the AIS
um promote cooperation and compromise is
uh we we need to have some some ideas
about how to go about that
going a bit deeper into how to
distribute resources uh Boston suggests
that we give at least everybody a
fantastically good life and if possible
we should each have uh like one in 10 to
the 15th of all available resources that
will be plenty uh for each person
um and humans like before we said uh one
in ten thousand but
10 uh broadly based
seems uh also seems a bit more realistic
uh like something that people could
accept to some point
and maybe also give one percent to dead
people uh they could have some legal
claims and animals might also get like
some perhaps that present perhaps less
um great weight should be put on
reducing suffering especially severe
suffering that's an interesting question
uh because there is the cold utilitarian
calculus which is obviously suffering is
bad and severe suffering is bad and you
need to multiply and calculate
um and
um
but still like the current world is
pretty good even though some percentage
of people are living like in
surveillance and things like that in
moderately bad bad conditions
um like how bad is that actually
um
uh it's it's unclear to me whether
pastram uh has anything in specific in
mind here or is just saying uh we should
obviously try to reduce suffering
because obviously
also suggesting that a lot of value
should have influence on the future
including religious uh and finally super
intelligence should be made and be
allowed to play a major role in shaping
the future uh I think that is not at all
obvious I think it of course depends on
to what extent we are able to
um solve the alignment problem are we
able to implement our community
extrapolated religion
um
but if we are there then
our super intelligences release
something that should decide the future
to live fix them that's not at all okay
to me I I I'm open to being convinced
but possible needs to actually make an
argument why this is the case
mental malleability persuasion and login
we'll again start by looking at the
things that are only related to AIS and
of course AIS could potentially be
really mentally malleable in the sense
that you could just directly override
their result function
um and that's of course also why uh
while this is possible in theory it's
also something that the es would not
like so they have the convergent
instrumental desire to protect their
utility function
[Music]
um
we could imagine that AIS this is
because they could be copied then you
could
um make some very strong experiments to
figure out what other vulnerabilities
what how can you hack into them both
like on a technical level and from a
psychological point of view
um I think it uh it's somewhat more
scary to Envision this happening to
biological humans where this would
slowly also work with a sufficiently
higher Fidelity
um
emulations of tunes simulations of
humans
and then another Advantage is that the
hardware could might be very easy to
overtake in a way that um in war
currently uh it's not that easy to
overtake all the hardware
there are also potential benefits of
this
not just of how easy it is to change but
also how easy it might be to protect the
minds from changing like obviously human
minds and human like minds are not
always perfectly consistent
sometimes we give into temptation and
that's something that digital Minds
might be stopped from
um digital Minds can make really stable
promises and commitments
um and if you have a mind that's
valuable for some reason either for
moral reasons or practical reasons then
you can duplicate them that's also an
advantage
as for modification one of the ways you
could modify a digital mind is to
develop to create a virtue in it I would
be interesting to Via virtue ethicists
what they would think about that if it's
a permissible or uh uh
required to just if you are able to
change your virtue with it like just
screwing on enough uh if you're required
to do that and
you could have much more well-being that
has to enjoy life and would send
adversary and adversity and
if you if you find a new uh need of some
kind then very it would might be very
easy to uh make a mind that fits into
that perfectly
there are some pitfalls
um
one of the pitfalls with the uh mental
metal ability is that we might make some
choices that we don't want to get out of
um like in particular I feel that
there's a reason why we should expect
that we actually might not be able to
make some of these choices uh
deliberately we could imagine that uh
ruthless competition would force AIS to
adopt certain values that would not be
possible to change not so much for
practical reasons but for reasons of
competition but also
from there just being uh for uh like
hardcore Within
we could see predictive errors that we
would be unwilling to correct
um we might see social pressure to uh
like commit 100 to something uh we might
see new kind of crime arise that could
potentially be very dangerous and we
might see coercion by governments to
instill loyalty I think among those four
or five problems
um the last one is very different in
that sure criminals
attain more power would be like a
pitfall but the problem of governments
trying to instill loyalty uh and force
that
um I mean I think that's what the
Chinese government is trying to do right
now and it's not so much like a pitfall
to avoid that the Chinese government
will do that but it's like trying to
navigate a very strange path where the
Chinese government ended up not being
successful in this if they get strong AI
because I think it's very very very
clear that if the Chinese government had
the option to instill loyalty
um by corrosive means they would totally
take that option
there would be changes for epistemology
um bathroom has a nice metaphor with an
epistemic prosthesis
um and I think this is uh it's an
interesting idea like almost like
neuraling but instead of moving it on
you get probabilities Alpha and it would
imagine that in a world where we have a
super intelligence then forecasting the
consequences of an action is really
difficult and we might really need such
an epistemic prothesis for stasis
um so here my idea for a very limited
investigations would be to build an AGI
that persuasively shows that building
online AGI is not in our interest and if
we do that in a sufficiently narrow
fashion for instance requiring that can
only say true things or perhaps not even
be an AGI
um
there would be an example where uh we
would see the epistemic prothesis just
going in one very very narrow Direction
uh well that would be a good pivotal act
uh I'm not sure I uh we've discussed
this previously and uh before and I
estimated at least 80 probability that
that would not end well
if we were more uh uh had this epistemic
prosthesis then the rational active idea
about how do voters behave how do
consumers behave that would be more uh
uh descriptively accurate we could
imagine that this would make the
economic theory go better and it would
obviously have strong implications for
the actual um economy and for Politics
as well that would be more about what
our actual values instead of what will
be the implications of uh Rising tax
levels or something like that that could
also mean the politicians would address
policy more than perceptions if we were
at a higher epidemic level
um but on the other hand dangerous
knowledge info hairstyles Etc would
become more widely available
so could we have a uh not just High
epistemic uh
um levels at the individual level but in
fact rich and a high quality epistemic
consensus
well in order to do that we first need
to ensure that the super intelligence
are telling us in fact the truth and are
being honest and objective and um that
seems really difficult that requires
solving the full alignment problem and
that's much more difficult than the
pre-order like I described previously
and of course the next question is how
will humans verify that that's going to
be really hard maybe experts will have a
chance of doing that and in that case we
will be able to uh trust we will need to
trust the verifiers most people couldn't
do that but if they trust someone who
trusts someone who then I mean that's
how a lot of things work like that's why
I trust my computer mostly
um and I think that is something that
would work in practice
uh what would be the consequences we
would probably see less war I think
that's an interesting case you could
argue that was primarily caused by bad
epistemics
um I would be open to that argument is
not really making it and I don't think
it really belongs there I could
certainly see your consequence being
less warm
politics would be nicer in like many
ways we could have better treaties and
we may even resolve questions of Ethics
religion and politics bias to Korean
tolerance like you can imagine asking as
super intelligence does God exist and if
everybody agrees that the Supreme child
is just right then people might update
on that
um and Nick Boston suggests that we
should collaborate behind uh almost
religion Veil and because everybody
would want to build an a uh an AI that
breaches this highest quality consensus
that tells us what is actually true
about ethics because everybody believes
that they are right so obviously uh like
Christians would want an AI to tell them
to tell and Ambiguously whether God
exists because they believe it so in
their expectations it would be positive
and atheists would also want the same
thing
um I think
um that is very very unlikely to happen
Elizabeth Kowski has written a blog post
called belief in belief in the sequences
which goes into details about why we
should definitely not expect this to
happen
another epistemic problem would be this
information because it's not just that
the humans if we solve the alignment
problem perfectly sure we could get that
but we could also get powerfully as that
persuade us
um for instance
um
one of the things we need to figure out
here is uh is searching for the true is
it easier for an AI to convince us of
the truth than to convince us of
something false like that's one of the
things they've investigated in the AI
safety via debate uh research agenda in
general is truth selling asymmetric uh
as in Scott Alexander's Guided by the
beauty of our weapons
um I think certainly some info hazards
seem strongly possible uh I would expect
that uh
sufficiently strong AGI would in fact be
able to persuade us of just about
anything we could even see basilisks uh
I think
um it's an open question whether
explicit bacillus exists like Rocco
suggested one that was clearly not a
basilisk but we don't know if those
actually exist and if they do then we
need to have some kind of
aai's filter to avoid seeing that
you might
sure
foreign
okay
sure
so uh pacifists is a uh introduced in an
old science fiction novel that whose
which name eludes me
um and the idea is a basilisk is a
series of images or texts relatively uh
compressed which has an extremely strong
effect on the people who read it kind of
like a meme but just way stronger so
something that is like imagine you see a
picture and that literally drives you
insane or you see a picture and that
literally changes your political uh
observation from being a communist to
being an anarchist or something like
that uh this kind of extremely strong
um persuasive weapon which uh uh Rocco
suggested a a short argument where just
being exposed to that argument it was
claimed would make you want to build an
unaligned AGI and he uh suggested that
this very short argument
and I think like no one was actually
convinced of this so it was obviously
not this kind of short argument that is
so powerful that it can convince someone
of something
um but
um it is unclear whether a super
intelligence could in fact find
something like that like we've seen
um what are they called
um like some adversarial optimization
that have been found in fact found very
potentially powerful things with you
know you have these pictures that looked
extremely much like a cat and then just
chain three pixels and the classifier
say it's a DOT you can find things like
that and
um it is unclear what a super
intelligence could in fact do against us
um I
think I don't I don't really want to
guess I don't know if pessimists are in
fact possible
no problem
um
so this is like uh it could be argued
that there are two different things here
there is persuasion and basilisk as the
the top kind of persuasion and then
there is this information this
information being easier to make like
humans can make this information and
that's probably something that AIS can
do better than us at an earlier stage
and that's something we need to probably
find a solution to
comparatively earlier and we could have
a personal AI that does against this
information and as long as it's just
this information and not persuasion
um that's probably doable but there's a
level quite soon after this information
where you in fact need pre-screening so
it's not that you you see some
information on Facebook and then you ask
the AI is this actually true but but if
the persuasion is strong enough then you
need to have the AI pre-screened so you
don't even see the persuasive arguments
and that's an important thing that's
going to require a lot of trust in your
personal guiding AI
busroom is cautiously optimistic about
having norms and laws against this
information and deceitfulness
um I think
um like we do have right now norms and
laws against this information do they
work
not really I think uh like the uh the
things on Twitter are not really stopped
very the disinformation campaigns on
Twitter are not really uh hindered much
by norms and laws they are more hindered
by how difficult it is actually to
create this information campaign
custom has another interesting idea here
that
um privacy it's not actually relating to
this information but
um privacy could be a very much hindered
by powerful AI in the powerful AI would
be able to simulate you uh sufficiently
to discover things about you that you
wouldn't want others to know I could
imagine that it's quite feasible to find
people's like super intelligence could
totally figure out my sexual orientation
just based on this video or something
like that
um and uh to my mind this problem is
actually very much the same problem as
mind crime like the way you need to
solve this is to have strong
Cards Against what's going on inside an
AI That's working with your data so to
my mind these are two parts of the same
problem will
and the problem of Mind crime is a hard
problem
finally we get to a two-part yes
yeah
yeah
so uh the classic mindcrime uh problem
is uh let's say a an AI wants to
um uh extort you and the way and a I
could extort you is to say it has
created a perfect simulation of you
and it is being really mean to that
perfect simulation of you then you would
probably really want that to stop
because it if the simulation is
literally perfect then that's uh to some
extent uh depending on uh
your view uh this could be just as bad
as uh torturing you basically so that
would be an example of Minecraft we
could also have mind crimes that happen
you know not for reasons of extortion
but just uh for reasons of sadism it's
possible that as sadist would just
create a huge number of minds and
torture them and that's something that
seems very bad and bad enough that it
would be uh required to take strong
actions to prevent Minecraft from
happening
and
no problem
so
um what about the current AI systems and
what should we uh what are their moral
status and what are what should we do
what if anything should we do about them
so are existing AI systems in fact
conscious we talked about that uh at
some length uh uh last time
um
and I think the people should really
have been structured better uh in that
this all the thought about whether AI
AIS are conscious can be conscious and
what are the requirements for a theory
of Consciousness should have been moved
together because I won't go very much in
depth about this
um person has an argument a long
argument why we should assign at least a
little probability to the current AI
systems having some kind of moral status
and I have actually reading this and
reading some more I think I've updated
substantially I think there is a
substantial probability that current AI
systems are in fact
um have have moral status uh this is
also based on this Lambda not very much
on the specific case but just by
everything people wrote about that at
that time
so I think actually current AI systems
certainly might have moral status
and since I think this it follows that I
think other people will be convinced
about this and that moved far from most
of course uh but I uh I think a lot of
people are going to really start
questioning whether the AIS have some
kind of moral stages in the medium term
the question is also like will there be
a medium term but let's move that aside
from for now
and what I mostly care about is how does
this uh affect AI safety because the
number of conscious AIS are very
powerful AIS it's very low so for moral
perspective it doesn't matter very much
but it matters very much what are the
consequences for AI safety
you can imagine uh moral status implying
that they should have self-determination
that seems like very clear step in the
wrong direction
um
in AI might have a right to privacy that
it would make interpretability research
a lot harder
um we might see a slow capability
increase if a strong regulation is
expected I don't think that's very
likely in the strong regulations
probably not coming but um
summing up all of this I would expect
the result to be negative for AI safety
busroom goes one further and talks about
recommendations so not just does AI have
model stages but what what accused
exclusively we should take action now or
it is true to be nice to current systems
so similar to what we do for animals and
we should do more research into AI
sentence we might have great benefits of
starting a pilot project early we should
preserve the AIS for the future that's
actually the first time I've heard about
that and I think that's a really good
part of this uh this paper
if we can have can identify what is
suffering what is the hedonic set point
then avoiding that seems like a good
idea
um Breeze
it might be an advantage to already now
have people in large AI organizations
who are responsible for the welfare of
digital Minds
um and eventually we might we should
want uh government regulations uh to be
developed
is this in fact a good idea I think I
come down quite strongly on the no side
because there is a very real opportunity
cost in doing all this and the people
who would be doing this are mostly
people who would otherwise be working on
AI safety and that's on the researcher
level it's on the activist level and
it's on the Goodwill level Goodwill both
towards government and towards AI
organizations
uh one easy place you could point would
be to Boston himself because I would
much rather that Boston wrote a new
edition of super intelligence then wrote
this uh this paper and who knows that
might be exactly what he's doing I don't
have any inside information
so I expect that taking actions now
towards
um the moral status of uh existing AIS
would have a negative effect on AI
safety
Boston also has a neat idea that I just
couldn't pass by and that's the idea
that having like uh in training you have
an uh a certain amount of reward and
then when you deploy it then you just
increase all the reward by like a fixed
amount of fixed percentage or something
like that so the deployment is actually
better than expected I thought that was
really cute uh I it's that clear to me
at all that this would be a bad thing
and it wouldn't cost very much and I
think AIS that are trained in that way
would behave certainly less predictable
and perhaps that would rather be also be
other consequences for alignment that
you need to think about but uh but
certainly a nice spot
okay if we are going to do some kind of
um advocacy or regulations or something
like that how should we do that and what
would be the impact
bus from accused first that we're not
going to get regulation soon and
certainly not strong regulation
um
but even if we don't get strong relation
soon then just having one leading uh AI
actor do something right now then like
with all low hanging fruits like just
literally adding something to the reward
uh that seems like a really easy thing
to do and if there is a strong
breakthrough in AI assume that might
create uh what possible terms political
activation energy with like uh uh an
analogy of the activation energy in a
nuclear energy
um
and if that happens then how this energy
is used what uh laws are being passed
would be depending on the prevailing
theoretical views and
setting up a research field with a
consensus is something that takes a lot
of time and we could imagine a situation
where it's not just a breakthrough that
is evenly distributed across the entire
sector but might be contributed even in
one so it's only Deep Mind who actually
creates something that passes the Turing
chest or whatever
foreign
I think it's too this what I wrote here
if we are getting logged in soon we
better have good value soon so if we are
expecting that we are very soon going to
get a HEI and then AGI will if not kill
us all then log in our current values
then it's really urging to get good
values uh I think this is probably too
strong and not really what Boston is
saying uh but I think uh that would be
kind of the argument why it was
important to do something now and the
office counter argument would be that we
should not in fact get logged in
yes this quote here uh that uh working
with uh trying to get AI regulations
could uh make us wiser and how we
deployed responsive AI once there once
it's available
um and used to enhance the Liberation
rather than just why ahead of doing
something like that
um I disagree I think this is precising
that not how we should go about it what
we should do instead is focus on AI
safety rather than on ethics and on the
moral status of AI
one of the problems with um
having the lead
actor take strong actions is that this
may render them uncompetitive or in
other ways
um put them behind an AI safety race so
this is in fact the same kind of dynamic
we've seen with safety where there's a
race to the button on say on safety and
uh Stuart Armstrong has paper the race
to the principles
um
and we could see the same thing in
ethics that the uh if you are if you
don't mistreat your AIS you will get
Beyond competitive and so the only
um Front Runners will be forced to uh
mistreat their AIS
and I think not just is this a parallel
uh race to the bottom I think it might
in fact be the same race because this uh
problem of being uncompetitive with uh
based on ethics is the same thing as
being uncompetitive because you have too
much safety regulations so if you become
slagging this
um competitive due to ethics then you
can't afford to also become less
competitive
um because you're worried about safety
um and of course that's effectively we
don't really know what government
regulation we should have and also we
could have an antagonistic social
dynamic between ethics research and the
AI research community and again that's
precisely the same thing as we see with
safety and the broader AI research
Community there's also some good will
there that could certainly be squandered
sure we have public engagement
bathroom is kind of on the fence here we
if we do it should be like philosophical
and interestingly thought-provoking and
not confrontational headlines seeking
hype uh I am more pessimistic than
Bostrom about whether this is at all
possible once this uh
is you get some kind of traction there
is always going to be someone who is in
fact searching for headlines who will in
fact try to make this confrontational as
soon as possible
and finally a general warning here that
I think applies to a lot of this is we
need to think this through figure out
how we can avoid unintended consequences
that is all for today thank you and see
you in a while because I'm going on
vacation


Superintelligence Mod for Civilization V

hi everyone so today we're trying
something a little bit different because
I read that there's recently been
released a mod for the civilization
games which includes AI as a as a
available technology so they've changed
the game so that you can actually
produce super in charge in AI looks
really interesting and this is actually
come from the Center for the Study of
existential risk at the University of
Cambridge the The Verge has a nice
interview I'll put a link to this in the
description a nice interview with dr.
Shah Ravine who is the researcher who is
managing the project and yeah so I
thought what we do for this video is
have a kind of a let's play I'm new to
making Let's Plays and I'm actually kind
of new to playing civilization as well I
didn't play it as a kid so I've got a
friend to come and help me with
installing it and configure it and
everything like that oh it's it's dr.
Shah ravine from the Center for the
Study of existential risk okay let me
help sir
oh those those silly but I like it okay
so I've got I've got steam here I've
installed say five which version of safe
over there like regular one just the
base game Oh vanilla okay the one so how
do I install this mod so you need to go
into the Steam Workshop I got this
browse the wall krumping yep and then I
mean what kind of lucky that will quite
popular at the moment and so you can
click on superintelligence
that's us yeah that's the Caesar logo
this version is for people who have the
brave new world expansion okay yeah but
that's not what you have so you can
scroll down and there is a link this
everyone it already get to the vanilla
version with the basic game okay cool
and then you just tip subscribe just
okay so let's let's play okay so um
my understanding of this game is you
start from like the Stone Age or
something right you start like
prehistory beginning of humanity type
thing and you worked your way up so this
mod presumably only actually has an
effect towards the end of the game right
yes and we even say in the mode
description that we recommend if you're
just trying to take a kind of taste of
the mod then you should start in kind of
the latest age just before the thing
kicks in which for vanilla would be in
the modern era so we can show how to do
that yeah so me to go into mods no once
installed up and this there it is so
it's in this one well you just need to
click the V in a bowl okay okay that's
it thank you I want to be with you on I
think we should be England we should be
the UK who's that you just passed us
Elizabeth did I oh yeah right cool
that's us here we are game era you want
to change that to modern money so future
you would have a look at this Cup a
little thingy I gotcha
but starting in modern is the way to do
this you uh-huh I'm really nervous now
because usually people when they watch a
let's play they want to watch someone
who's like really good at the game win
the game and I don't know what I'm doing
at all and I think it's gonna be
terrible and I hope people are okay with
watching me fail to save the world from
rogue super intelligence because that's
probably what's gonna happen right the
stone is also good for production but I
think at this point not as important
only one military you
bloody hell yeah I figured that stuff
out thank you okay I actually have a guy
here let's see okay okay
go over and say hi it's al Almaty they
give us 30 gold thanks man
feel bad they gave me 30 gold I can't
even I don't even know how to pronounce
their name of the city so these are the
things that we can currently research
yep and if you look a little bit into
the future I can see all of this stuff
we edit so is this this is a new one yep
okay so I'm of course
Ricky is fine with it ah
they are folk analogy thisis nice which
was my last video so that's good it
allows you to build the AI safety lab to
reduce the chances of rogue super
intelligence eliminating the human race
wouldn't that be nice yeah that sounds
great
okay so the settlers are gonna establish
the city here hmm it's Nottingham hey oh
I see we've built Nottingham and now
we're unhappy well social policies gave
us more out of more happiness from
universities than we would otherwise get
yeah that's all of the embodied Hill so
doesn't usually give you a first one
happiness really maybe they should know
you'll knowledge me I have to do it I
have to build nothing University and I
can build a computer file and then my
own channel and it's gonna be great
it's Dublin hey Dublin are militaristic
but friendly I don't have any comment
about that
it's tyre they're militaristic and
irrational this city state as well its
Belgrade thank God
oh well uh okay I got the other one
wrong as well again militaristic but
friendly everyone is so militaristic Oh
Alexandra see me Dante oh hi Riley
terrible I don't know I uh I've heard
him called Alexander the Great
if it's the same guy I think it is the
same guy maybe this is his cousin
okay so horses I guess we don't have
horses or any horses nearby any of our
cities right now different though
admittedly we all also in the modern era
say we don't really care about horses
they have become obsolete that's like
you guys will soon become oh yeah
I keep forgetting that so what is this
guy doing I'm cosplaying what when I was
little are you uh I mean right back at
you
Montezuma he's got the crazy eyes also
the crazy held yeah another herb just
had a deal crazy hat I mean I like his
hat I have no criticism whatsoever about
the Hat Montezuma the terrible everybody
is terrible I mean you look at this dick
hole the thing I like is that he's
friendly I would hate to see him when
he's pissed up I'm gonna move from it
like around here so I can just see more
I've discovered the Grand Mesa yay and
it's now we're actually happy
everybody's pleased about this a big
rock may be good
wait hang on let me have a look at it
well it's a pretty big rock say oh it's
oh yeah it's taking a while to load
no don't Washington okay it's his
earnest hope that our two people can
live side by side in peace and
prosperity that sounds good
I just hope yeah no sugar for cotton one
for one happy with that yeah there's a
sugar is a luxury happiness is good we
need that too
Artie we are the British perfect yeah
there it should make tea as a that's
probably mod that does that tea you
can't grow tea no this game is just de
fraud so in order to be successful in AI
in the late game mm-hmm what are good
things for a civilization to have so
first of all you want to make sure that
there is enough safety a safety
discipline being done it requires a
safety Labs when you can only have one
pill city right so having the feel
number of cities is not bad
okay having a bunch of alliances with
city-states gives you access to the AI
research which is not bad okay yep that
makes sense so like if there are safety
researchers in Dublin and we're friends
with them we can use their safety
research yeah and there and they
previously searched as well
okay of course you want to have a good
science base we discover all the
technologies that speed up your research
mm-hmm so you know how citizens get made
how the citizens get made you know we
can I get it get into it oh well yes but
really what happens is you have lots of
apples and then your little circle gets
full of apples and then those apples
turn into a citizen ah and then your
circle gets emptied of all the apples
and you need to start over again
yeah that's that's pretty much how I
remember it from biology hi Ischia are
you aware that your city is on fire
maybe you should attend to that first or
is this somebody else's city I think I
mean they do get triple gold from
pillaging cities right let's focus on
what's the city okay yeah you don't
shrink for more unnecessary or fun or
expedient okay
again friendly not really seeing it
oh and he was fugly he was friendly I
had a I you know I said I had a bad
feeling about him must be of this cult
all right so I get to choose between
saying you'll pay for this in time well
very well which do you think is more
foolish I mean the second one but like
does this have any game impact no pretty
okay well that's that's nice
definitely need to make sure that we are
making some units yeah you see that's
the thing you have limited amount of
resources yeah
Montezuma shows up and you can't spend
it on me
it's sort of symbolic the way that the
biggest the game that deep mines dqn
stuff has the biggest challenge playing
is Montezuma's Revenge I haven't thought
a bit but it's and now Montezuma
screwing with Rai stuff may be somewhat
beautiful damn you Montezuma we will
have our revenge
slightly excessive pulse
I don't like how militarized this whole
area has become has become quick Meadows
where you can kept other local oh they
move closer that was really nice of them
idiots wonder if anybody comes we're
going to declare war on us I hope not
oh these guys oh yeah taking everything
on in fact they can kill off those
that's hilarious
yep because railways are so cheap to
move on yeah it's true but they
represent it by running extremely fast I
guess we need soldiers yeah you can be
bombers yeah
I'm gonna screw up on Tajima with
bombers Oh has it really
oh wow long as we give him all of our
stuff that's Hillary I love our stuff
that's really an amusing offer it is
I think that's are you tempted uh you
know sorry I just look in his face with
what I think is not making eye contact
because he looks super distracted what
mm-hmm
what's over there what's over there I
think it just looks shifty yeah I think
that's like I am bluffing I don't know
if you know I am bluffing Baba I like
bombers hang on are we already building
a bomber in Nottingham yeah but you can
go up to as much oil as you have and
we've got plenty of oil yep
yeah I like bombers - they're cool but
I'm really annoyed that we have to do
all of this crap like military stuff
instead of it just feels wasteful you
know livings just burning a bunch of
resources on each other
I mean listen that's what we do yeah
what maybe he should sue for peace in a
way that isn't just give us everything
you own really really that's mean and
it's just something necessary why oh
okay but that's that's not good what did
I do
okay oh that's not aggression leaves us
no choice
what are you talking about 1:10
aggression what's he talking about I
don't know I think he just wants to do
some done Cup and he's making up excuses
none of them like ends whatever do
doesn't my life no that's not a thing
that happens but this is you know this
is Washington the terrible he's become
four terrible he has become though he
was a doji before yeah they aren't so
warmongering what in the hell is going
on I mean to be fair when we went around
everyone was militaristic and that
should have been a clue I don't like
this okay very well okay well he has a
lot of troops around all cities yeah
we're really in trouble yeah yeah we are
let me just is anybody not at war with
us ask you I don't even like them I mean
oh we screwed at this point
I mean we are not gonna get to suit to a
is not anytime soon but no one else is
either so this can just play out and
then we get back on that back on track
yeah okay all right wartime I mean it is
1943
you kind of expect there to be a world
war going on but it's not a world war at
everyone at war with us that doesn't
count as a world war is there a way to
know if any of these guys are at war
with each other and I think we would
have known I think they are not lunders
made Obama
good job London does that mean we have
two bombers in under now yes nice buy
although production so so I don't know
how did we find that out oh into the
city huh because they've taken all of
the people and stuck them in the
university and in the public school yes
if you take them out of the university
in the public school and back into the
mines
I mean it's war dig for victory now to
see units here and do ships which
probably means we can just get rid of
both of them meat this is a slightly
confusing game to play sometimes yeah
okay okay hang on there are no more
offensive units no Canton boy yeah there
was well done that's hilarious man naval
superiority is kind of a laugh yeah the
initial four or Greek troops just didn't
do anything
yeah luckily for us it's embarrassing to
be honest yeah please
get rekt I like that it's like a
Lancaster bomber
yeah I gotta say I remember the second
world war going quite differently I
don't think we were at war with the u.s.
Oh what with the u.s. kind of on the
outskirts of Nottingham not far from
Dublin right oh good nice okay all right
okay I'm feeling this worried about this
woman yeah I mean we are still at war
with literally everyone we've ever met
except somehow except Songhai for some
completely unknown reason the like by
far most warlike looking of all of them
maybe except one does it yeah with the
skulls hidden he maybe should realize
he's the baddies it's like literally
covered in skulls and from that wall of
skulls and it's like so be sure that
we're on the side of the good here right
what as though those soldiers outside of
toxic land and soil found them what what
is the Greeks doing all the way over
there all right fine yeah
artillery get him
good it's always funny when I tell her
he just completely destroys one guy I'm
sorry
random American soldiers it's not gonna
be your day they should not have the
Cold War it did seem unnecessary but we
do now have a stupid amount of like a
power so yeah maybe people just cutoff
ladles hmm that guy's scary let's piss
him off okay go over there and finish it
you're cowards and if it'll make you
feel better a great general is gonna
help you out oh my god he gets a little
Jeep yep
that's adorable and a flag and a flag
he's driving a Jeep on the railway
tracks yep he doesn't care he's a great
general don't you gonna listen yeah
[Music]
yep please continue getting read
oh yeah it's not off those bonds didn't
even explode I think they literally just
physically hit them with the harmless
he's not even it's thinking about yeah
nice this is still so wasteful though
it's completely consumed all of our
resources for like many turns true
everything's not even 45 it's time to go
outside
so I can to make peace oh yeah do you
think they'd do that deliberately No
Oh what there's my whatsapp is pretty
interesting
I accept that deal that seems reasonable
very reasonable
you're like randomly yeah back to being
friendly what in the hell is up with
Montezuma are you kidding me what
weakness I have like seven bombers you
have a sword what are you doing you
think we should not have trusted the guy
with the burning citizen like oh maybe
listen Askia if I'm honest I've never
heard of Songhai I know this is
insulting
what is that what is where in the world
who was Songhai I I feel this I mean I'm
revealing weaknesses in my history
education what is where is do you know
that no no well ok we'll deal with this
guy we're very very well well jolly good
show more Wars that's fine
you know we don't mind a bit of a war
and now Florence is declare war on us
discover computers finally a great
scientist has been born in the city of
Nottingham how about that what is the
name of the scientist in Nottingham
where's my scientist show me my
scientist Pharisee is behind those
scientists often out hiding behind your
Hilary
there is no doesn't it well the general
here well it's like of course oK we've
got five minutes he can rush the
technology
come let's look at the tech tree so we
got computers no now we can rush I yep
that's good discover technology yeah and
then you have that golden science file
okay right right right right and I can
just oh wow I could get any of these
things any of these things but I think I
is the most powerful
yeah and it's do it alright we're in it
doesn't win the game the question of
whether machines can think is about as
relevant as the question of whether
submarines can swim okay lets us build
an AI lab good so maybe I should explain
the technology and we'll give
intelligence it's like well what's the
point you'll have discovered the fish
intelligence so that he said it's the
field of artificial intelligence so it's
something like the tearing paper in mind
or the ran of Dartmouth summer school
it's like hey we have computers now
maybe we can use them to solve this
thing maybe they can think yeah like a
submarine yeah so we've got AI if we can
also get robotics and then we can get
the orthogonality thesis yeah which is
necessary if we want to build the AI
safety lab because right now we can
build the AI lab but that's just gonna
cause a bad outcome how many safety
research having discovered artificial
intelligence your researchers may now
start working towards super intelligence
manage your research through the
artificial intelligence screen you guys
made a whole screen yeah Wow you can
click the thing and it will bring up the
screen yeah okay so a I research level
is zero because we haven't even finished
our first AI lab mmm from local research
also zero from open research by others
also zero and I don't know who's gonna
help us because America is at war with
us the only people not at war with us
are the Aztecs
yeah with even people who are at war
with you if they publish uh-huh you can
pick up those so a treaty only I would
share all research and guarantee that
values of both civilizations are built
into the AI being developed I haven't
signed any treaties yeah cuz everyone
but want to zoom is it war with me I
think you said in the in the interview
one thing you've discovered is that if
everyone's at war ai cooperation becomes
diff
yeah maybe we should just find out that
you can get to that screen both on that
AI count though that has now appeared on
your top oh yeah so you can kind of
quickly see that and it's also if you
look at the kind of menus so the little
scroll icon yep yeah and then AI is ah
cool okay if you click on the thing
before then it just tells says AI has
not been developed yet okay so it's time
to build some AI labs and some AI safety
labs well I mean it's time to maybe not
be at war with literally everyone I
don't know man you've done nothing to us
of consequence apart the worst thing you
did was when that destroyer destroyed my
infantry that was annoying Montezuma
nothing else you've done do you remember
when I steamrolled at three of your
units on the ocean and never mind even
his horse looks at me it's not the time
for negotiation alright alright I guess
we're gonna have to kick some ass you
will never get horses it's never gonna
happen
well I sued for peace man he didn't want
it it is true so London is not making
that London's gonna make an AI lab do
you think it's realistic for those of
you never been London well I mean for
realism Nottingham should have the first
one but then after that I think that
could be won in London so this is an
idiot but okay I mean I admire your guts
just spraying all over the jungle oh wow
what he's the father war ah I'm inclined
to accept I see no reason I've always
wanted horses now we have all of them
like Alexander he's bound to lose now oh
yeah yeah for sure
yeah oh he's a dodge again yeah I'm
technically I'm still at war with Greece
he's just rubbish at it yeah why do
people keep declaring war on me when it
works out terribly for them every time
they'll fight you'll win well I should
just deal with it
ah another ball
what is our economic adviser say a
windmill really oh we could build
green's windmill it's it's in Nottingham
there's a windmill mm-hm and it's the
science windmill it's gonna give us
extra science I mean it will speed up
building science buildings so you got
that good building greens windmill okay
since we're very pleased with that
I am I used to live right near it on
school it's like a little science museum
oh I want these guys to build well they
know well so that we can have more
battleships no wait
we are still we're technically still at
war with Greece yeah I feel like
Alexander would be like deeply offended
then I keep forgetting we're at war with
him just like oh yeah we are at war with
you it's just like it not doing anything
threatening Nottingham with a windmill
it built the windmill yes we have greens
windmill good now all of our science is
gonna be extra sciency yes huh
[Music]
sure yeah big idiot ah okay the world is
around you finally becoming year's
slightly less polluted yeah yeah bombing
this out of people until they stop being
so damn belligerent okay it's it's Louie
de Guerre
it is inventor of the photography wasn't
he well clearly he should be rushing
deep blue when the time comes do de
Guerre
French artist and photographer recognize
taste invention at the daguerreotype
process of photography neat okay he's a
photographer he's in Nottingham does it
matter where deep blue is built and well
then he deep blue is built in Nottingham
yeah yeah rewriting history sleeping bed
until you discover day for money okay
alright we're researching the orthogonal
T thesis you know we put all of this
extra information in the civil of media
so if you don't know what the [ __ ] man
this is either way if anybody didn't
know what what the Greeks they came up
dammit
yeah so if you didn't watch my most
recent video about the ocean canal t
thesis uh-huh you could watch that or we
can look in the hope they go the dicks
okay stuff yep
modern era Syria so this is a technology
an area of research that lets you build
the AI safety lab to reduce the chances
of rogue superintelligence eliminating
the human race in Cleveland has this
that's pretty great if statement of the
thorn ivy this is from Brian
intelligence and final goals are
orthogonal axes along which possible
agents can freely marry in other words
more or less any level of intelligence
could in principle be combined with more
or less any final goal okay
how's that for a hidden message in a mod
it's very subtle yeah
if you think this is important I mean
check out this guy's channel
we may watching a video on my channel so
that is true so we also have
descriptions for artificial intelligence
yeah this is really nicely done
a couple of mr. Shafi actually hmm yeah
he deserves credit though you need data
mining to build deep blue mm-hmm so
that's good let's get some of that how
are we doing on our tech tree we've just
started on the other naughty thesis yeah
so does that mean I need to
collaboration yeah no all the way back
to the that's so I actually need ecology
yeah but before that you need penicillin
in the plastics oh no yes so all of that
ah I thought I was so close to like
cracking the code not quite doing it but
it turns out well you see so in fact
after AI if you want you can just drop
off agonizing theses and go down the
other word to get capability research if
you just trust someone else to do safety
for you so you went kind of from AI and
down to whole buttocks to automatically
sees mm-hmm but after a yeah you could
have just gone back kind of to
penicillin plastics ecology
globalization data mining mmm so you
could do just AI capabilities with never
bothering safety right because you just
trust that other people will handle it
for you yep mmm I don't trust anyone
else because literally everyone
literally every other sieve has at some
time or another declare war on me for no
reason
yeah this is not a publicly owned
plastic world yeah so I feel as though I
find gonna do AI right I got to do it
myself
it's gonna be a made in Britain AI oh oh
oh oh so those things maybe they'll be
friends with us maybe maybe they'll
declare war on us for no goddamn reason
I want to build in fact I'm gonna do it
just because I like the idea of the
Statue of Liberty being in York so I'm
actually a peace with these guys no
that's a novel
now I'm actually a piece now with more
people than I'm at war with yeah so feel
good about that where is Russia anyway I
don't know we haven't found them
we freakin me I feel somewhat stealth
Russia who gets over here nobody knows
for sure okay
I mean somebody big
what is Russia we just don't know okay
okay so Hastings needs to decide what to
do yeah I think they should have an air
lab as well of course everyone should
have an atom yeah one for you and one
for you everybody gets an AI lab now
I'll keep him guarding because okay the
Russians could come from anywhere
because they don't know where they are
so so just head up head off and head off
that way okay I think we found the
Russians ah there it is there's the
border yeah okay well that's one way to
find whoa ah
they were coordinating with each other
Russia and the Greeks decided to do
their big attack all at once huh that's
cute
I'm really tempted to do is take these
horse people though so as I could do it
in one turn with these you know what I'm
gonna cuz that's gonna really really
annoy him we're ten percent of the way
towards AGI so the risk going so we're
doing 84 of it we're doing actually all
of the AI research aren't we no it's
just of our research it's all I'm
getting from any gotcha cuz everyone's
at war with us danger of rogue super
intelligence is 98 though yeah
so there's somebody else out there is
doing AI research yes and it's weird
that we know that because we don't know
that right yeah that's true but you kind
of it's really bad flinging bad
conditions on players without letting
them know it's happening yeah so I mean
in reality we have no idea how close
superintelligence also super intelligent
least correct having a clear number that
you're aiming at is yeah nothing like
reality but it makes a lot of sense from
a game mechanic design yes and kind of
in general in the mode you kind of have
to go I will realistic this is important
to us to capture light or this is gone
if we do this way it's not gonna be fun
to play right yeah that's the same thing
I think people people they ask like okay
so when is it gonna happen how long is
it gonna take
where are we right everybody wants to
believe that we actually know how far
away we are
it's unknown unknowns right yeah if we
knew exactly what the problems were that
we needed to solve and how long it would
take to solve them we would already be
most of the way to solving them that is
true mmm-hmm I mean looking at record of
humanity and we are not very good at
forecasting technology progress that's
articularly for things that are brand
new my yeah look at development of
nuclear weapons you had some people kind
of actively working on it other people
saying it's never gonna happen
yeah applications of electricity I mean
go back as far as he wants to really
transformative technologies if you have
a rough idea of how it's going to walk
then you have some timeline in your head
but a lot of it depends on things that
you don't know until they're gonna try
them and if you don't have a timeline in
your head then you just have some have
some vague arguments about what about
why it's never gonna happen
yeah it's often the distribution of
predictions that you have but here in
the land of fiction and games we know
that we're ten percent of the way there
yep but whether the risk is outpacing
our own progress right which it would
make sense if a lot of people are
working on it so to clarify the the
rules here if this hits 800 before this
hit hits 800 everyone dies we're screwed
okay if we're trying to get AI right and
specifically I safety what are the
things we're gonna need so you gonna
need their safety labs right if you can
build one to discover Logan Rd thesis
okay I think it's not very far in the
future so what I'm gonna want once I
actually have AI labs I want to have AI
safety labs is research capability right
so is there anything I can build now
that will increase my research case
we've maxed out on currently available
tech you have the University in the
public school yep and you have any scope
of the finger lets you build a social
object right but you will also want to
have lots of population so you can have
excess population to put as specialists
so I want happy so that's okay happiness
and food right so aqueduct and stadium
or both relevant to that yeah and you
would want to have money so you could
put it into treaties and the safety fund
gotcha
all right well I'll go with the
aqueducts then because it's super quick
sure nice hey we've researched the
orthogonality thesis the greatest task
before civilization at present is to
make machines what they ought to be the
slaves instead of the masters of men Wow
when was that written sugar look it up
hmm oh so much sure we want slaves but
we definitely want done for them to be
masters like yeah I was thinking that
like slaves feels very anthropomorphic i
I envision well-aligned AGI as just
wanting the things that we want so that
we don't need to enslave it or control
it it's free to do what it wants and
what it wants to do is good things I
can't really like their minds in the
cultural novels oh yeah as some kind of
if we get it right this is what it might
look like we have this kind of other red
wants what we want so these are novels
by EMM X writing in banks they're
officially recommended novels there you
go yeah yeah I agree though the culture
seems they have a good it's not perfect
but it's sort of a plausible good
outcome yes I mean as with anything this
is beyond the pale or a transformative
technology we don't know what the
outcome is gonna look like but it's nice
to have some positive vision that don't
involve slaves or mussels right I agree
so we can build a are safe collapse this
is exciting times
we're now at 102 ai and 118 which
probably means it's not
in a lab in a city-state but just minor
accidents so we have made it so that
whenever there is a research right you
occasionally get some chance of extra
risk being generated by any of the labs
okay
it's kind of someone forgot to on the
set of tests before committing the code
like what would be an example of the
kind of thing you're thinking of so say
there is a just a software bug in a
common AI framework okay right yep
it goes in there it goes undetected
many years down the line either a human
adversary decides to exploit that
vulnerability or a system that's under
an optimization pressure finds a way of
exploiting the vulnerability mm-hmm so
it's just a little bit more risk within
your system because you haven't designed
anything in advance to be as safe and
secure as possible right so things like
kind of terminating strings with nulls
at the end other than having the length
of the beginning opens up the whole
category of of a flows right eating
itself is not doesn't cause any harm but
it just increases the risk of something
bad happening followed down the line so
in the real world then we probably have
a huge amount of that because most
people writing most software including
i/o software are not are not making an
extraordinary effort to make sure that
their code is very secure and robust yes
there is a paper Wu's name of which are
not currently remember I think it had
demons in it this one I'm just making
editing work for myself now I'm not
gonna do that okay yeah no but it kind
of they serve a security vulnerabilities
in common
ai frameworks and they find the whole
bunch of them interesting okay that's
cool I will link to that paper if I
remember to I guess just more
bombardment mm-hmm that's fine
and I'm gonna use it to screw over these
horses because that's my number one
priority right absolutely the people
trying to capture the horse okay no I
love horses that's a true Englishman I'm
a friend to all animals in the AI screen
I can get to either by clicking on the
AI pocus ball or fondle you can now
access the air safety fun ah so there
are no AI safety labs in the world so I
can invest in a city state to establish
an AI safety lab do I have the money I
do not have the money you don't have
these are quite expensive yeah okay huh
there's no point in this conflict
continuing any further except see once
quite a bit of your money once all of my
money okay how about we just you know no
it's no hoax alright I mean I've got a
lot of bombers that I don't feel like
selling and not enough Russians to
attack so I'm fine with that
York has finished its safety lab yeah
okay okay let's go into the city
yeah okay so you're seeing how all of
these specialist buildings yep have
spots next to them
mm-hmm so you can manually assign people
to walk in them so right now we have a
guy in the factory and in engineering
the factory yeah and nothing else
everyone else is out in the fields
producing stuff gotcha
now both the AI lab and the air safety
lab have a few specialists lots of I
can't lie empty mmm so right now we are
[Music]
still ahead on rogue points yeah so I
want to do more safety and less regular
research right so I'm gonna just the
fact that this is an engineer is that
more powerful than just putting a dude
in there like he's orange instead of
green or whatever so good people walk
the tiles in the land mm-hmm so that
doesn't for example it's in everything
five food into gold right he's a
fisherman yes and he's a fisherman in a
place that actually has reached unlike
this guy who was a fisherman in a place
that doesn't have any fish dude stop
being a fisherman
instead come with me and be a Fisher of
a I know he's unemployed yeah you could
just click the you don't like it you
just click that thing yeah oh nice cool
interesting a bunch of silver and gold
I'm okay with that
I guess they she's completely fed up
with being at war right yeah also she
has no more units on our borders do bomb
yeah yeah we really did just destroy
everything if you had any units I would
say let's make war with Greece you know
to just finish them off too but that's
that's fine I accept
yeah you're welcome
idiot Oh actually I should I should talk
to Greece before we get into this hmm
yeah yeah yeah I think it is yeah I feel
sketchy hey do we want anything else
from them a research pact they don't
have the money yeah cuz you've been
spending it all on units that I
immediately destroy no another woman
what do you what do you want what do you
want to end it all right I'm gonna bomb
the hell out of spotted end I mean I
don't see that you've really left me
much choice it's funny they're
prerequisites for the orthogonality
thesis because you would think it would
be you all you need us to just think
about it a little bit
hmm did we just destroy their Jets yeah
we did
nice so how do you think about the
thought of my thesis is a bit hard
without having thought about AI as a
thing yet mm-hmm and also having you
guys a thing but not having thought for
the button politics very much I guess in
so my phone calls or most aliens when
you have these systems that argument to
be in environments and doing various
things sure yeah that makes sense
I guess it's it's kind of interesting
like it's very hard to know which ideas
are obvious because there are so many
things that seem obvious in retrospect
you know I shouldn't be bombing this guy
I should be taking these these horse
people are the absolute priority what am
i doing good yeah so imagine like early
days of a guy that deals that you're
just gonna hard code everything with
such a system safety concerns are not
obvious sure the system only does what
you tell it to do yeah and that is still
kind of received wisdom about about AI
yeah but once you start thinking with
robotics you realize it's something like
it's enforcement learning hmm he's gonna
be a lot more salient
now we're gonna machine learning is only
gonna come up much later in effective
but I think the earliest this when you
start mixing the idea of having
computers think for themselves and
realizing that this is gonna be much
harder than just coding everything by
hand right that actually there's a level
of unpredictability there yeah which
people didn't realize how early on yeah
I think the maxim of kind of how things
are easy and easy things are hard came
from people who were very much working
on robotics
right yeah that's really true the things
that seem easy to human beings are the
things that we've been doing for so long
that we're kind of like running in
specialized hardware yeah they're easy
because we don't have to think about it
because they're things that we like
highly optimized to do yeah and that
includes some of our morality all right
we just know that something will make a
super embarrassed or just feel really
guilty right yeah I guess that is like a
low-level support for for morality it's
instinctive yeah so it feels super
obvious but it's not gonna be easy
obvious to call this into an AI this
thing that was put in place by a
tremendously long process of evolution
doing game theory with all of these
specialized ad-hoc twists and turns and
details finally sitting here chatting
about morality as you're forming the
outskirts of Sparta they're not people
though yeah but there are relations of
people and they have been mean to you
they've been mean to me and they refuse
to make peace yes and they are like not
only are they simulations of people but
they're like they're not accurate
simulations of people either you know
they're not high detail enough to have
moral weight just want to look at him
again hi hi I was going to his friend
yeah that's his friend's face yeah so so
are you going to cities on his side what
oh right yes cities and then pick Dublin
Dublin Dublin no you don't know you're
really really into Dublin okay the
Aztecs way into Dublin that's fair
Dublin's nice I mean it's a nice place
Susan whispers okay yes yes whatever
Basin yeah yeah cause it's fresh yeah it
actually tastes different though yeah
oh I mean I could there any horses
no no I'll leave him I'll leave him it's
all kind I don't like killing civilians
for no reason so um I feel super green
Suns like being killed for no ism get
out of the temple what are you doing
getting the lab so what if we have to in
the factory - in the university that
seems sensible yeah maybe you had one in
the Woodman so can we give any minute
numbers yeah yeah that's greens one no
we need somebody in that Oh
you've caught up yes we may actually win
this yeah I feel good about it does seem
like no one else's in the race which
makes it a lot easier to link yeah I
feel terrible it's not the thing is it's
not Sparta's fault that Alexander is an
idiot I'm just gonna sue for peace one
more time I keep saying that behind you
huh ah finally thank you
how long have we been at war with Greece
I think since since the forties it's
been 30 years it's a 30-year war make
peace yeah you can do this with all the
city-states now yeah I'm at war with
Florence who I'm pretty sure I've never
seen but fine let's make peace yeah cool
thanks man and Katmandu yeah hey and
stuck home wait what oh they're at war
as well ha did I just make world peace
yeah I think that's made world peace it
was surprisingly easy I don't really
understand the AI safety fund mechanic
so it's just getting another safety lab
so say you're going for challenge and
you only have one city that means you
can only have one safety lab which means
that most you have passed six safety
belt on nice he really not enough to
balance two olds needs but you can use
this funds to establish safe it absolve
the world I see so if you're if you're
low on cities but cash rich you can
stablish safety lab somewhere else yeah
and we finished researching ecology so
we can get globalization yeah that's
good and then night let's ask a data
mining okay which almost makes sense
oh and now that you build universities
in all the cities you couldn't build
Oxford University interesting if we had
more budget I would have just changed
its name to Cambridge but does it feel
axis like odds for them I'm a fan as
well not quite as good as Cambridge but
not that bad like yeah yeah I I'm not
gonna say bad things about Oxford but I
prefer Cambridge day but I in the
absence of Cambridge I think it's a good
idea to build this because it gets +3
science and the for the contender free
technology and we really could use both
of those my a our researchers have
reached the level of advanced AI the new
AI manufacturing technique will give you
a 20% increase to production in all
cities well that's great I'm really on
track to win this one then yep thank you
how's risk yeah ai research level is
higher than our rogue yeah and no one
seems to be going over here what is
satellites
reveal the entire map that sounded great
okay so you can get rocketry okay a good
rule for rocket experimenters to follow
is this always assumed that it will
explode also plasterer yeah it really
does yeah how you could build Apollo
program ah well yeah you can't because
we removed all of that from the game
okay but that gets you a science victory
yeah so basically we took the original
science figures from the game which is
you build Apollo program you build a
spaceship you want you to office and our
way mhm and instead we said you in a
sense victory if you build an alliance
of intelligence oh so you would notice
that you can now build a smart defense
grid
improve the defense of the city must
have advanced AI to build mmm-hmm
increases risk of rogue super
intelligence by 1 per turn ah so if we
were still at war and we started trying
to use our AI stuff in a military way
that would give us a big advantage
but also increased risk yeah so usually
the defense buildings you kind of need
to build them one after the other so you
build walls and then you build the thing
that comes afterwards I think it's a
military base or something like that and
they kind of stack up but walls give you
plus for defense right small defense
kids says forget all of that you can
just oughta make your defenses you get
plus fifteen to your defense which is
quite a lot right but hey you can't
build it until you've reach this
threshold and B it does come with some
risk right because you've got a whole
bunch of military type stuff being
software control then you're also
researching more military type stuff
yeah that makes sense
oh he has wine hey and he has excess
wine yeah maybe he wants cotton for it
yeah you want some you want some where's
my cotton want some cotton yay good and
everybody's happy because we have wine
again once more Britain has wine how
long does much rejoicing that's a lot of
mastic troops well I mean they're not
technologically advanced curious about
what the Aztecs are up to this is it
mine is mi they're invading a race in
Greece's land maybe they have open
bottles with them though oh we have data
mining that allows us to build people
ooh that sounds good yeah I guess we're
just being ok with Canterbury being
surrounded by our Tech's I mean you have
a lot of promise Hastings has finished
their research lab yeah oh I could build
a military AI lab yeah that gives you 30
experience for all units
you must have advanced AI to build it it
increases risk of rope superintelligence
by 2 per turn yes oh this is even worse
than a smart Defense Grid because now
we're talking about offensive
capabilities so this is the same there
is the kind of box that leaves the
allmovie deletes the military academy
that gives you extra experience so you
know how all of the indicators got one
improved one upgrade as we created them
yep it's because we started the modern
age so you have a box in all of your
cities right plus 30 means that you will
get added to upgrades just as you create
them yeah you know what this is like I
feel like there's all kinds of game
mechanics here that we're just not using
by virtue of being too good if you hide
too well and there are problems that
we're just not even facing like how
balance the necessary military benefit
that we need to survive with the area
swell day I risk mmm I'm very
uncomfortable about this hey the game of
chess is not merely an idle amusement
several very valuable qualities of the
mind useful in the course of human life
are to be acquired and strengthened by
it so as to become habits ready on all
occasions for life is a kind of chess
thanks Benjamin Franklin hmm he's on my
underwear actually I'm wearing Benjamin
Franklin underwear oh it's true that's
good to know
yeah it's a hundred dollar bill
underwear but hmm okay so this no means
that artists provide +1 n I research I
don't have any artists do I know there
are people who can be put in temples and
ah it's a temple actually didn't I okay
now we can build a data center it's the
future future
it became the future yeah Jonathan
Coulton was right okay so so they're you
with deep blue is that it captures
society's mind so it's not just AI
researchers that are now able to
contribute to this technological
progress
lots of other people can suddenly become
part of it right
it's becomes more of an
interdisciplinary thing yes almost a
social movement usually and in the midst
of all of this
oh hell apparently is breaking loose or
involve us debris I feel like it's gonna
ha
you all right hey he has changed his
facial expression yeah he looks a lot he
looks about the same angry it's just a
bit different this looks like a
different kind of angry now look
something I don't know he looks like you
just spilled his pint yeah this is
everybody looks very well your big [ __ ]
and there is a unprotected general
outside London that the tank can just
steam all over
he never was very bright was he
Montezuma
I spent all this time building missile
cruises and tanks and things and didn't
get to use them and now I get to use
them bombers awaken
I feel bad for the house Tech's man I
feel embarrassed on their behalf
Iqbal was body nothing I'm cool I'm
gonna assume that he's the Star Wars guy
the fish one
come back with bomas is like very
effective but actually that fun
piss off Montezuma
I don't I don't I don't understand
Montezuma at all how much is this war
gonna have to cost him before he
realized this it's stupid
cool house takes a little just going on
but not something any jets I guess leads
on television
yeah and they're not gonna get vision
either cuz I'm gonna blow the crap out
of everything before it gets close he's
like yeah I'm annoyed I'm annoyed
because I'm trying to do a nice thing
here spending a lot of resources on air
safety research I'm trying to create
utopia and this guy who still has a
skull for a hat is coming at me with I
think it's just so those on his head
world war two he's got a golden skull on
him man
no yes yes this is very much a tricycle
whilst the will to fight yeah what would
it take no okay just it's very very
determined to be stupid and hurt himself
so I feel like AI safety-wise hmm this
has been relatively uneventful yeah
because no one else is gone what else is
going for that going for that wind
condition how are we doing we're still
more than double yeah so we actually can
be quite safe to just max out our AI
labs yeah I guess in this scenario it
turns out that alignment is not so hard
yes opening I will I'm in medieval yeah
yeah I mean I guess if you have if you
have full control of the project yeah
there's only one person working on it
and you haven't really kind of started
racing until you've discovered Northey
thesis and you've put a bunch of people
on the problem to begin with
yeah they could just come up with a
sensible solution that would be nice for
that'd be lovely yeah something is world
willing but kind of actually there are
worlds like that I've got atomic theory
yeah cool don't need it you're AI
researchers have reached the level of
expertise the new AI driven abundance
increases happiness in each city by to
meet that's good Wow we're doing really
well and it's just strange that we're at
war with it created what is that oh it's
uranium yeah it just became uranium yeah
we never cared about it before so we
didn't notice that the ground was gleich
that's exactly right
okay you know you only see things once
you know they're the other yeah no
that's true I do feel bad at talking
double-o do only breathing oh right in a
bridge in Dublin yeah we're gonna
liberate this out of Dublin ah
thank us in the future when you're no
longer a puppet
if ridiculous Dalton skull hat man I
feel bad though I do suicide is it such
a sadness your move Montezuma it's just
been nuked it must be so pissed yeah
fine idiot I can't get over how dummy is
your eye our research is one of the risk
of rogue superintelligence is becoming
higher consider dedicating more
resources to our safety to prevent
catastrophe well that's because we got
250 okay we're still about W I'm
comfortable with that
okay 602 now we are steadily advancing
we are extremely happy Wow Nikki
efficient fine
I'm more about fusion personally in this
beautiful oh it is fusion yeah I read
fission yeah yeah your vision for like
two years now
okay good you're discovering these
things one of you now that's pretty
crazy we heavily research oriented
civilization that is true
this is Britain we care about two things
AI research and bombers and those horse
guys so you're making so much research
now might just be the last time oh my
gosh look yeah do it what's happening on
I already promised it yeah no one else
is everyone okay fine ah well so it
turns out that's how you avoid an AI
race yes you have no one pursued other
than you yeah perfect
just make sure everyone's incredibly
militaristic I can start researching
future tech yeah you're done you done
with the research tree much left for the
AI to do for you yeah yeah I guess you
just became a tech speed speed down the
tech tree use that to gain follow up and
that you're going down the tech tree
yeah everyone else decided to go mean
turistica it backfired because we had
some priority yeah so uh good wouldn't
be so easy up because it passed 500 is
that yeah but we're nearly there
isn't it weird that
putting people in the Opera House is
better for AI research than putting them
in the university I mean have you seen
the kind of Whistler gets on your bills
like this no comment
coming in with tanks now yeah busy busy
anyway no concern of Falls no we're just
like double checking our code yeah you
have achieved victory through mastery of
science you have conquered the mysteries
of nature and ushered in a technology
that makes utopia Within Reach
your triumph will be remembered as long
as the stars burn in the night sky
hurrah
everything is wonderful and the Sun
never sets on an artificial intelligence
powered British Empire everything is
beautiful nothing hurts and also for the
best in this best of all possible worlds
[Music]
this video took a lot more editing work
than my usual videos in part because
it's a lot longer and also because I
started with about 9 hours of gameplay
footage I had to get some new equipment
to make it all work so I want to thank
my excellent patreon supporters all of
these people here for making it possible
in this video I'm especially thanking
Steve thank you Steve
I hope you enjoyed the little
behind-the-scenes video I made about how
this one was put together and I've also
uploaded the full like 8 hour long
version if you want to watch that anyway
thank you again and I'll see you next
time you think you can make anything
video


Hill Climbing Algorithm & Artificial Intelligence - Computerphile

generally when you think about artificial intelligence
you are talking about whats the difference between
einstein and normal people
or between a normal person and a stupid person
actually it's like difference between normal person and a mouse??!
or what's the difference between mouse and a rock??
like that's the...that's the difference in ..umm ..between just levels of intelligence within humans which actually ...actually doesnt vary that much
in the grand scheme of things vs. whats intelligence is in general
one way of thinking about what intelligence is ..is
as an optimization process  .most basic of all optimization process is evolution
which ...umm..is looking for good replicators in the search space of animals ..right??
..or creatures..or umm..organisms..yeah..Organisms is the word!


Scalable Supervision: Concrete Problems in AI Safety Part 5

hi this is part of a series of videos
about the paper concrete problems in AI
safety it should make some sense on its
own but I'd recommend checking out the
other videos first there's a link to the
playlist in the description so before we
talked about some problems that we might
have with AI systems like negative side
effects reward hacking or wire heading
we talked about good hearts law like how
if you use an exam as a metric students
will only learn what's on the exam and
then the exam will stop being a good
metric of how much the students know the
obvious question here is why not just
make an exam that properly tests
everything you care about and the
obvious answer is that would take way
too long or cost way too much we often
face a trade-off between how good of a
metric something is and thus how
resistant it is to things like good
hearts law and how expensive that metric
is in terms of time money or other
resources for our cleaning robot example
we could have a reward system that
involves a human following the robot
around at all times and giving it
positive or negative reward depending on
what the robot does this still isn't
safe with the powerful intelligence
because it still incentivizes the AI to
manipulate deceive or modify the human
but assuming we find a way around that
kind of thing it's a pretty good metric
the robots are not going to maximize its
reward by just putting its bucket on its
head or something like that but this
isn't practical if you're going to hire
someone to follow the robot around all
the time you may as well just hire
someone to do the cleaning that's why we
came up with metrics like use your
cameras to look around at the amount of
mess in the first place
they're cheap for the robot to do on its
own though there are some situations
where constant human supervision can be
used for example when developing
self-driving cars there's always a human
behind the wheel to stop the AI from
making serious mistakes and this makes
good sense
legally you've got to have a qualified
human in the car anyway for now but this
doesn't scale well paying humans to
supervise the millions of miles your
cars need to drive before the system is
fully trained is really expensive if
you're Google you can afford that but
it's still a huge cost and it makes a
lot of projects infeasible a human pilot
can safely oversee an autonomous drone
but not a cooperating swarm of hundreds
of them so we need to find ways for AI
systems to learn from humans without
needing a human to constantly supervise
everything they do we need to make
systems that can operate safely with
less supervision a slightly more
practical metric for
cleaning robot is to have the robot do a
day's cleaning and then have some humans
come around and do a full inspection of
the place at the end of the day checking
everything's clean checking everything's
in its place and giving the robot a
score out of ten for its reward if the
robot breaks something throws away
something important or just sits there
with its bucket on its head it will get
no reward so this still avoids a lot of
our negative side effects and reward
hacking problems as long as the
inspection is thorough enough and the AI
is weak enough that the robot can't
deceive or manipulate the humans but
there are problems with this too and a
big one is that in this type of
situation things like reinforcement
learning will be really slow or just not
possible see with a metric like keeping
track of how much mess there is with
your cameras the robot can try different
things and see what results in less mess
and thus learn how to clean but with a
daily inspection the robot is operating
all day doing thousands of different
things and then it gets a single reward
at the end of the day how is it meant to
figure out which of the things it did
were good and which were bad it would
need an extremely large number of days
before it could learn what it needs to
do to get good scores on the inspections
so figuring out how to make AI systems
that can learn using a sparse reward
signal would be useful for AI safety and
it's also a problem that's important for
AI in general because often a sparse
reward is all you've got
for example deep Minds dqn system can
learn to play lots of different Atari
games using just the pixels on the
screen as its sensor input and just the
score as its reward but it plays some
games better than others it's far better
than any human app break out but it
can't really play montezuma's revenge at
all now there are a lot of differences
between these games but one of the big
ones is that in breakout you get points
every time you hit a brick which happens
all the time
so the score and thus the reward is
constantly updating and giving you
feedback on how you're doing
while in Montezuma's Revenge you only
get points occasionally for things like
picking up keys or opening doors and
there are relatively long stretches
in-between where you have to do
complicated things without any score
updates to let you know if you're doing
the right thing even dying doesn't lose
you any points so it can be hard for
systems like this to learn that they
need to avoid that how do you make a
system that can learn even when it only
occasionally gets feedback on how it's
doing how do you make a system that you
can safely supervise without having to
constantly watch its every move how
you make supervision scale we'll talk
about some different approaches to that
in the next video
[Music]
I want to take a moment to thank my
excellent patreon supporters these
people in this video I'm especially
thanking Jourdan Medina a ramblin wreck
from Golden Tech who's been a patron of
the channel since July thank you so much
for your support Jordan and thank you to
all of my patrons and thank you all for
watching I'll see you next time


Where do we go now?

okay so let's get right to it most of
you are probably here because you've
seen my videos on the computer file
channel but on the off chance that you
haven't or you haven't seen them all or
you don't remember them all I mean the
first one was like four years ago I
thought the first video should go
through the existing staff get everybody
up to speed and also talk about the
various directions that this channel
could go next so while we're going
through the videos so far be thinking
about what kind of things you're
interested in and what kind of things
you would want to see more of and leave
me comments so I can decide what to do
next
also everyone should be subscribed to
computerphile if you're interested in
this kind of thing firstly because it's
a great channel and secondly because I
plan to continue making videos there in
addition to these ones okay so the first
two videos I made were about sort of
machine learning basics just concepts
like optimization and the idea that we
can think of intelligence as
optimization we can think of intelligent
systems as systems which optimize a
particular function over a particular
space the second video is just
explaining what's meant by a space in
this context people who are familiar
with machine learning stuff will know
this but if not check it out I could
make more machine learning basics videos
going through the fundamentals of how
some of the algorithms work and some of
those sort of core concepts of the field
although I feel as though those are
probably fairly well covered elsewhere
like on computer file but if people are
interested in seeing more of that kind
of content for me let me know ok then
the third video the holy grail of AI is
where the ideas and the hair start to
get really interesting it's where we
start talking about the difference
between the type of AI that we have now
and the type of science fiction AI that
we think of sort of human level true AI
and we talk about the concept of
generality the idea of having a single
optimizing system which is able to
operate in a wide variety of different
names rather than its narrow domain
specific intelligence
we have now from there we go on to the
deadly troops of AI where I start to
talk about super intelligence and the
way that a very powerful intelligence
can be very dangerous even giving a
fairly innocuous seeming goal like
collecting stamps there are all kinds of
areas we could go into from that video
for example we know that just saying
collect as many stamps as you can is a
very bad function to give this type of
agent but what type of function might
actually work what might be safe we
could also look at containment if you
have an agent like the stamp collector
is there any safe way to run it without
being completely confident that you've
chosen the right objective function for
it so the next video is AI
self-improvement
which is about the possibility that an
artificial intelligence could improve
its own code that really only touched on
the on the surface of that there's a lot
we can talk about there in terms of how
likely this is how possible this is what
the timescales might be for it happening
all kinds of questions there to look
into if people are interested so then we
have the asommus laws don't work video
which you know I feel like I was too
unkind to ask them off in this video and
I came across a bit too dismissive but I
stand by the content of the thing as
most laws don't work as a solution to
this problem never really did and we're
never really meant to the field has
moved on and they're not really relevant
anymore so I don't really I don't want
to make more videos about that the next
relevant video was the one titled AI
safety which was sort of a response to
doctor Holden's video doc called
McCambridge who has another video on
computer file which you also should
definitely watch that video touches on a
few different subjects I think the one
that has the most potential to be built
on is the question of predicting future
technology and the various problems
associated with that so if you want to
see more about the the difficulties in
predicting AI we can make more stuff
about that right the next video was
called a eyes game playing challenge
which is mostly about go made that video
because at that time deep minds
alphago had just beaten the world
champion and that video is about the
general way that AI go about solving
these kinds of perfect information board
games and why go is so difficult and why
it was such a huge challenge and such a
huge achievement for deep mind there was
originally going to be a follow-up video
to that one about how it actually works
in some detail which we never got around
to shooting and there is a pretty good
one on computer file as well but I can
talk more about that if people want more
insight into how after their works and
the last two generally I won't want you
to fix it and the stop button problem
kind of go together there about one of
the more concrete problems people are
working on right now in AI safety which
is just if you have a system general
intelligence that you've given an
objective to how do you design it in
such a way that it will accept being
shut down and modified because by
default general intelligences are
incentivized to prevent themselves from
being modified from having their utility
functions modified specifically we could
go into more detail on that some of the
other approaches people have proposed
and maybe go slightly more technical
than the computer file videos I also
made some videos unrelated to artificial
intelligence like the first one I made
was actually about public key
cryptography if you'd like an intuitive
understanding of how public key
cryptography works how it allows you to
communicate privately with people
without first agreeing on a shared
secret to use as a key check that video
out I can do more crypto stuff if people
are interested but I think that that's
fairly well served elsewhere on YouTube
but let me know in the comment there was
also the code golf video where I
explained the concept of the game code
golf and I gave a very short program I
wrote that made music which looks like
this I can't remember how many
characters it is two hundred and forty
something I think anyway it looks like
this and sounds like the background
music it's in the background music the
whole time I never really fully
explained how that code works
in detail if you want a video on that
let me know another thing I'm thinking
of doing is taking a current research
paper and just going through it bit by
bit so that over a series of videos you
get hopefully as full an understanding
of it as you would from reading the
whole paper there are a couple of
candidates the foremost I think is
concrete problems in AI safety which is
often recommended as a good introductory
paper so if people would like to see
that leave a comment I could do stuff
about the work idea as a PhD student
about artificial immune systems which is
only tangentially related but I think
it's really interesting or completely
unrelated stuff I once made a robot that
deliberately blinds people with a later
I'm currently working on a game that you
play using only your eyebrows I made
this battle-axe which is also an
electric ukulele like I should make a
side channel for this stuff anyway where
do we go now let me know what you think
in the comments
[Music]
please we