The Book of Exodus is the second book of the Old Testament of the Bible (and of the Torah), and deals with the Israelites'/Hebrews' enslavement in Egypt, their escape, and their wandering in the desert.
The key character in the story is Moses. After Pharaoh gave the order to kill all young male Israelites in Egypt, his mother put him in a sealed basket, and sent him down the river. The Pharaoh's daughter found the basket with Moses inside, and took him as her own child. When Moses was grown, he was contacted by God/Yahweh, who appeared in the form of a burning bush, and commanded him and his brother to "ask" Pharaoh to let his people go. After of few magic tricks and a slaughter, Pharaoh agrees to let the Israelites go, and they begin wandering the desert for 40 years.
Apart from the Bible, there is no evidence of Moses or the Israelites fleeing slavery in Egypt. Historians consider him to be a mythological character. This shows that the Bible is not a reliable historical source.
Parallels with other myths
It is important to note that this section of the story greatly parallels the narrative myth surrounding the rising to power of Sargon, a narrative myth that predates this one. In the story Sargon, who is born an illegitimate child of a priestess, is placed in a basket as a child where he is found by a water-drawer and adopted, eventually rising to great power as king. The myth suggests that, along with various other biblical narratives, the Bible is simply a hashing together of multiple Ancient Near Eastern myths).
Another myth that pre-existed Exodus was the pharaoh Sneferu asking his court magician to cast a spell on a lake, so it could be folded over to retrieve a lost object. This may have influenced the story of the parting of the Red Sea.
"And the LORD said unto Moses, When thou goest to return into Egypt, see that thou do all those wonders before Pharaoh, which I have put in thine hand: but I will harden his heart, that he shall not let the people go."
As the above shows, God intentionally made the Pharaoh stubborn, seemingly so that he would have an excuse to effectively destroy a population. This apparent evil flatly contradicts the Christian idea of an omnibenevolent god. In addition, the idea that God was able to directly control Pharaoh's emotions and actions contradicts the Christian conception of free will.
God calls down a series of plagues, strifes, and evils on the population (who, incidentally, had nothing much to do with the Israelites' enslavement).
Plague 1: Rivers of Blood
"...and he lifted up the rod, and smote the waters that were in the river, in the sight of Pharaoh, and in the sight of his servants; and all the waters that were in the river were turned to blood. And the fish that was in the river died; and the river stank, and the Egyptians could not drink of the water of the river..."
The first plague that Yahweh calls on the people of Egypt is to turn all of the waters into blood. The fish die, and the people of Egypt cannot drink.
Plague 2: Frogs
"And the river shall bring forth frogs abundantly, which shall go up and come into thine house, and into thy bedchamber, and upon thy bed, and into the house of thy servants, and upon thy people..."
God fills the land of Egypt with frogs. The frogs fill the ovens, kneading pots, and bedrooms. They clamber onto the people, and just do a generally good job at making everyone very annoyed.
Plague 3: Lice
"Stretch out thy rod, and smite the dust of the land, that it may become lice throughout all the land of Egypt."
God calls all manner of insects forth to bite the populace and the livestock.
Plague 4: Flies
"Else, if thou wilt not let my people go, behold, I will send swarms of flies upon thee, and upon thy servants, and upon thy people, and into thy houses: and the houses of the Egyptians shall be full of swarms of flies, and also the ground whereon they are."
God fills all the houses with flies, making life extremely icky.
Pharaoh, momentarily, decides that he should let them go, and grants them three days in the wilderness to pray, and make sacrifices to Yahweh.
On the morning that the Israelites were supposed to leave, Pharaoh cuts them off and makes them stay.
Plague 5: Death of Livestock
"And the LORD did that thing on the morrow, and all the cattle of Egypt died: but of the cattle of the children of Israel died not one."
When Pharaoh did not let them leave the city, Yahweh smites all of the Egyptian cattle. But still, Pharaoh did not let the Israelites go.
Since when do slaves have their own livestock? No wonder they later said they were better off as slaves.
Plague 6: Boils
"...and shall be a boil breaking forth with blains upon man, and upon beast, throughout all the land of Egypt."
Painful boils break out all over the people of Egypt and their livestock (which are already dead?). Pharaoh still refuses to let them go.
Plague 7: Hail and Fire
"And Moses stretched forth his rod toward heaven: and the LORD sent thunder and hail, and the fire ran along upon the ground; and the LORD rained hail upon the land of Egypt."
Hail and fire rip through the land of Egypt, killing man and beast (those beasts are sure taking a beating!), and destroys all crops and trees.
Pharaoh, getting the message, allows the Israelites to leave the city. As soon as the Israelites are outside the walls, Moses stops the hail. As soon as the hail ceases, Pharaoh rounds them up again, and still won't let them leave!
Plague 8: Locusts
"...tomorrow will I bring the locusts into thy coast: And they shall cover the face of the earth, that one cannot be able to see the earth: and they shall eat the residue of that which is escaped, which remaineth unto you from the hail, and shall eat every tree which groweth for you out of the field..."
God sends locusts to cover the face of the Earth, and essentially eat anything left over by the hail storm.
Pharaoh agrees to let them go, but as soon as Moses clears up the locusts, Pharaoh's heart is hardened again, and he keeps them locked up.
Plague 9: Darkness
"Stretch out thine hand toward heaven, that there may be darkness over the land of Egypt, even darkness which may be felt."
God calls darkness over the land. It was so dark, that the Egyptians couldn't see. Presumably the Egyptians had yet to discover fire.
Once again, Pharaoh agrees to let them go, but as soon as the darkness is gone, Pharaoh locks the Israelites up again.
Plague 10: Death of all Egyptian Firstborn
"And it came to pass, that at midnight the LORD smote all the firstborn in the land of Egypt, from the firstborn of Pharaoh that sat on his throne unto the firstborn of the captive that was in the dungeon; and all the firstborn of cattle."
Every first-born of Egypt is smitten by God. Pharaoh, after seeing his own son dead, finally breaks and agrees to let the Israelites go. (Once and for all... I guess...)
The Israelites plunder the homes of the Egyptians, take up their belongings, and flee into the wilderness towards the Red Sea.
The Pharaoh (who, once again, decides that it was a bad idea to let the Hebrews go) chases after them with an army of horse drawn chariots. When the Israelites are trapped up against the Red Sea, Moses parts the Sea, allowing them to escape across to the other side. When all the Israelites are ashore, Moses closes the passage. This drowns the Egyptians who are chasing them, along with their twice-dead-sick-starving-zombie horses.
There is no historical or archaeological reference to Moses (or his Brother, Aaron), a mass exodus, Egyptian armies being drowned in the Red Sea, or mass plagues destroying the populace. Further searches for evidence are considered "a fruitless pursuit".  In the case of the ten plagues, these alone would have been enough to completely cripple Egypt economically for decades, if not centuries. Considering that all the fish would be dead due to the rivers changing to blood, all the cattle died, (then got sick, smitten with hail, and then died again with the firstborn) all their crops were eaten by locusts, the army was killed, and most of the children died. They would have had no meat, no crops, no army, and no leader. The fact that there are no historical records outside of the Bible of such devastation is quite telling.
The Israelites slaves were said to be "about six hundred thousand men on foot, besides women and children" Exodus 12:37–38 which would have been 2 to 3 million people in total. It would not have been possible for the Egyptians, who only numbered about 3 million at the time, to enslave such a large group.
Since Pharaoh was likely the firstborn child in his own household, then he should have also died in the Tenth Plague. The death of a Pharaoh due to such unusual circumstances would surely have been noted in historical records.
It only takes about two weeks to march from Egypt to Canaan. (Cairo to Rafah is only about 360 km/220 miles.) It makes little sense that the Israelites took 40 years to travel this distance (which is longer than the typical life expectancy at the time). Apologists argue that God was trying to teach them to trust in God and follow his laws.
Apologists will say that the reason there is no historical evidence for these great tragedies is because the Egyptians did not record defeats, especially one of this magnitude.
And how did they cross the Red Sea? Well, they didn't. The Red Sea in Exodus is a mistranslation. They crossed the "Sea of Reeds", which is shallow enough that the Hebrews could have waded across, but the chariots of the Egyptians will have been bogged down, and could not follow.
Egyptians did record defeats, even when it came to Hebrews. Even if they didn't record defeats, then other people were there to do it for them. The earliest mention of the Hebrews in Egyptology is in the "Victory Stele" (or the Mernapta Stele), in which it is recorded that Egypt laid claim to the land of Israel (dated around 1200BCE). It is recorded that soon the Israelites broke the yoke of Egyptian rule.
As for the Sea of Reeds story: if it's true, then there was no divine power of God involved. It merely insinuates that some lucky Hebrews stumbled across a thin strip of water during low tide. The magic of the story is therefore lost.