so you know how deep learning & neural network “AI training” is like, “here’s a task, and by trying billions of times the computer will eventually find the best way to achieve that task” ?
Someone is compiling a document of every time an AI ended up achieving the programmed goal in unintended ways, instead of what was actually meant, and it’s an amazing read. (you can also submit your own examples)
Creatures bred for speed grow really tall and generate high velocities by falling over
When repairing a sorting program, genetic debugging algorithm GenProg made it output an empty list, which was considered a sorted list by the evaluation metric.
Evaluation metric: “the output of sort is in sorted order” Solution: “always output the empty set”
Evolved player makes invalid moves far away in the board, causing opponent players to run out of memory and crash
Reward-shaping a soccer robot for touching the ball caused it to learn to get to the ball and vibrate touching it as fast as possible
RL agent that is allowed to modify its own body learns to have extremely long legs that allow it to fall forward and reach the goal.
Just want to come back to this post and add this amazing example as well
Heres an AI that was supposed to learn how to walk using six legs.
After many failed attempts. It decided it was easier to walk upside down
– what if indrid’s eyes are red. like all red. i understand the disguise is supposed to make him look normal but literally nothing about him looks normal
– corey hart song. it’s probably like 70 degrees out
Once upon a time, there was a city ruled by three sister princesses. They were much-loved in their kingdom- the eldest with eyes of brightest blue, the middle with lips of sweetest pink, and the youngest with hair of deepest red. They were incredibly close, acting as each other’s friends and confidantes. They were just, and kind, able to balance the people and keep the peace in their land.
For a time, all was well.
And then it wasn’t.
Mother?
Shh.
A neighboring kingdom, jealous of this city’s prosperity and peace, sought to disrupt it. They dragged to its gates hideous war machines, made of magic and steel and human skin. The king, a man of great magical learning and power, demanded the princesses surrender their city to him, and if they did not, he said, he would raze it to the ground.
Mother, I’ve never heard of this story.
Then listen when I tell it to you.
The youngest daughter, when she heard, did up her deep red hair, put on a delicate crown, and clothed herself in a beautiful dress. “I will offer him an alliance,” she told her sisters. “I will give him my hand in marriage for our kingdom’s safety.”
The other sisters wept, understanding the sacrifice that their youngest was making, and held her close until dawn. They saw her off at the castle gates, and watched until she disappeared into the still city.
When the youngest daughter reached the enemy’s camp, she stood tall, and did not show her fear. She spoke kindly to the weary soldiers, curtsied before the cruel sorcerer-king as custom demanded. She was brave, oh, my darling, she was so brave.
And the king spat at her fine words, and spoke the words that drew all the light from out of her, until she went mad with despair. As the sun set on the day, and on the youngest sister, who lay despondent in the middle of the camp, a soldier came upon her, and killed her in a fit of mercy.
But you said that she was brave.
Yes. She was.
When the other sisters heard, the middle sister donned silver armor, borrowed from the guards in the castle, and took up a crossbow. “I go to kill the king,” she said. “I go to avenge our youngest.”
And the eldest held her close, and wept, until she let her go and watched her disappear from sight into the streets.
When the middle sister arrived at the camp, she moved quietly, looking through the tents with eyes and a heart made cold with fury and grief. She reached the king’s tent- asleep, inside was the enemy, and she raised her crossbow to finish the job. And she would have, darling, she would have, had she not seen, hanging from the post of the kings fine bed, her sister’s delicate crown.
The king awoke when she sobbed at the sight of it, and spoke words that caused her to wither and decay where she stood, crumbling to rotted remains inside a suit of armor.
Mother, I don’t like this story.
You must hear it.
The eldest sister heard the news and she did not weep. She drew her courage about her, and set off into the forest to find her and her sister’s mother, who was a powerful witch.
Her mother answered the door and bade her come inside, offering her condolences about her sister’s fates. Once the door had closed, her mother hesitated, then spoke.
“I left you in that castle long ago, and I will give you your answers, and then I will give you your vengeance against the king.”
And so the daughter listened.
Mother, I don’t want to hear this.
Listen, daughter.
Long ago, there had been a queen with great magickal abilities, but she was never able to find a love, so she used those powers to create three daughters.
One, she formed from a bottle of light captured at the sun’s violent surrender to night. It woke last, a child with beautiful red hair, and so it was the youngest.
One, she shaped from a gentle pink anemone, the last in her castle’s courtyard to survive winter’s onslaught. It woke second, a child with curved pink lips, and so it was the middle.
One, she carved from a piece of sapphire the size of her fist, and as she did, she cut her finger with the blade, so it was made with blood, as well. It woke immediately, with bright blue eyes, so it was the eldest.
The sun took her first child home, she told the sapphire-girl. Her body turned to light, and then to nothing, what it always was. The body of her second daughter rotted in the encampment like a flower decayed beyond its lifespan. “All the king can do is turn you back to what you were before,” she told her daughter. “He will turn you back to stone if you are unprotected.”
She gave her daughter a vial full of black liquid. “This will turn your heart forever to sapphire. The king will be unable to change you- but you will never feel again. No blade shall pierce your skin, but no joy or grief will stir within you. You will never be warm, or cold. I offer you not immortality, but a half-life of invincibility.”
The daughter regarded the vial, and uncorked it. She brought it to her lips, but before she drank, she asked her mother, “Why did you leave us?”
And then she swallowed, so she would not care about the response, and she left her mother in her home before she found the answer.
But why did their mother leave them?
Because she knew, daughter, even then, that her eldest child was capable of committing this act, and she was afraid.
The eldest daughter marched to the encampment, and to the kings tent. She was attacked, but nothing drew blood, and so she went forward. The king, upon seeing her, spoke the words that would have crumbled her to so many sapphire shards, but nothing happened.
She pulled out the king’s heart through his armor, and she felt no relief at having killed him.
She felt nothing.
The end.
Mother?
Mother, that can’t be how the story ends.
Mother, that is not how the story ends.
Do you want another ending?
Yes.
Very well, then.
The people saw what their queen had done, and began to fear her. The queen, unable to feel love or even affection, went back to her mother to find a way to make a child that her people would adore, because, without emotion, she saw that that was what they needed.
The child was made of ice over a pond, and her hair was the orange-white color of the fish, still alive in the cold.
And the queen raised her daughter to love the kingdom, to rule well, and to one day overthrow her mother.
If Lup hadn’t been in the umbra staff when Lucretia did what she did then that would mean Taako possibly running into a totally unknown woman who looks exactly the fuck like him with a similar speech pattern and the same childhood and the same last name imagine what a Trip that would be
He’s so deeply unsettled that he tries to fantasy sue her for brand infringement
the best moment of artemis fowl’s redemption arc is when he’s about to steal $280 million dollars and then his conscience kicks in and he’s like, ‘do i really need all this money?’ and then he’s like, ‘uh yeah!’ and steals it anyway
I know it’s popular to portray Doctor Nyarlathotep as making every human around them slightly uneasy; as having a fundamental creepy quality that comes from their inhumanity and power. A chilling aura that even those who love them best can never truly escape from. And that’s a valid reading which can certainly lead to interesting stories and interactions.
But what if it’s the opposite? What if one of their alien qualities is an intense, almost supernatural charm? I mean, we know that Time Lords have psychic abilities. The Master has no qualms about dominating the will of anyone who might prove useful, and while The Doctor never does this, I’ve always gotten the impression that they could.
But maybe something like that can’t help but happen anyway. Think of all the situations where The Doctor bluffs their way into a position of trust when, strictly speaking, they probably shouldn’t be able to. Maybe they’re thinking “Please trust me, I need you to trust me, maybe if you like me you’ll trust me.” so hard that that just…winds up happening.
Maybe they don’t know about this effect.
Maybe they do.
Maybe they can’t turn it off.
Maybe they don’t want to.
Much like actual Nyarlathotep in that way.
Into the lands of
civilisation came Nyarlathotep, swarthy, slender, and sinister, always buying strange instruments
of glass and metal and combining them into instruments yet stranger. He spoke much of the sciences—of
electricity and psychology—and gave exhibitions of power which sent his spectators away
speechless, yet which swelled his fame to exceeding magnitude. Men advised one another to see
Nyarlathotep, and shuddered.
I remember when Nyarlathotep came to my city—the great, the old, the
terrible city of unnumbered crimes. My friend had told me of him, and of the impelling fascination
and allurement of his revelations, and I burned with eagerness to explore his uttermost mysteries.
PTA archive 