This morning on NBC, he was FOR gay marriage:

DAVID GREGORY: And you're comfortable with same-sex marriage now?

VICE PRESIDENT BIDEN: I-- I-- look, I am vice president of the United States of America. The president sets the policy. I am absolutely comfortable with the fact that men marrying men, women marrying women, and heterosexual men and women marrying another are entitled to the same exact rights, all the civil rights, all the civil liberties. And quite frankly, I don't see much of a distinction-- beyond that.

DAVID GREGORY: In a second term, will this administration come out behind same-sex marriage, the institution of marriage?

Well, I-- I-- I can't speak to that. I-- I-- I-- I don't know the answer to that.

And then, this afternoon from the Obama campaign...

David Axelrod

@chucktodd @meetthepress What VP said-that all married couples should have exactly the same legal rights-is precisely POTUS's position.

For those who don't understand what Axelrod wrote:

Joe Biden Gay Marriage Reaction: Frustration As Officials Walk Back VP's Same-Sex Marriage Comments

But the possibility of Biden becoming the highest-ranking U.S. official to endorse marriage equality was short-lived, as his office and the Obama campaign immediately walked back his comments, saying they were totally in line with the views of the president, who does not support full marriage equality rights.

"The vice president was saying what the president has said previously -- that committed and loving same-sex couples deserve the same rights and protections enjoyed by all Americans, and that we oppose any effort to rollback those rights. ... Beyond that, the vice president was expressing that he too is evolving on the issue, after meeting so many committed couples and families in this country," said a Biden spokesperson.

On Twitter, top Obama political adviser David Axelrod said, "What VP said-that all married couples should have exactly the same legal rights-is precisely POTUS's position."

Gay rights supporters reacted with frustration and disappointment to Axelrod's comments.

"David Axelrod is once again frantically trying to push gay stuff back in the closet. This is really quite ludicrous," tweeted Michelangelo Signorile, host of The Michelangelo Signorile Show on Sirius XM and editor-at-large of The Huffington Post's Gay Voices.

"All Axelrod's denial does is further tick the gays off while doing nothing to dispel the notion on the right that the president already embraces gay marriage," wrote prominent LGBT blogger John Aravosis on his site, AMERICAblog.

"Remember those 5 minutes when Biden was for gay marriage? Good times," quipped Chris Barron, founder of the Republican pro-gay rights group GOProud.

Winnie Stachelberg, executive vice president for external affairs at the Center for American Progress added, “We commend Vice President Biden for supporting marriage equality and call on President Obama to do the same. The campaign shouldn’t force Biden’s comments back into the closet, but should instead embrace the growing popular support for the freedom to marry.”