The name Bourne came from Ansel Bourne, a preacher in Rhode Island, the first documented case of "dissociative fugue", a condition not unlike dissociative amnesia or dissociative identity disorder (multiple personality disorder). One day in 1887 he forgot who he was, started a new life in Pennsylvania under the name Brown, and opened a convenience store. About three months later, he woke up and not only remembered his life as Bourne, but forgot all of his life as Brown, and was quite confused as to why he was in Pennsylvania.
Matt Damon climbed down the last 30 feet of the building himself, without a stunt double. He called it "the most gruelling thing I had to do."
Matt Damon trained in the Filipino martial art Kali for the movie. Kali involves using the aggressor's energy against him and conserving your own energy.
As of 2014, this is the only film in the Bourne series with any resemblance to the plot of the book on which it's purportedly based, and it's a very loose adaptation. All other movies in the series are original screenplays that use only the titles of novels by Robert Ludlum and/or Eric Van Lustbader.
Doug Liman wanted the camera operator to be late moving the camera, adding an "edge" to the photography. So he didn't let him watch rehearsal - that way, he wouldn't know which character spoke next.