Beyoncé and Jay-Z Photo by: Frank Micelotta / Getty

Beyoncé and Jay-Z arrived at Scarsdale Village Hall shortly after it opened at 9 a.m on Tuesday to get their marriage license. "It was just the two of them," an eyewitness tells PEOPLE. "They were very polite and smiling as they filled out the paperwork. They were holding hands for a while. They looked really happy."

Could their happiness be because the longtime couple is finally putting the constant wedding and split rumors to rest? Although a rep for Beyoncé, 26, had no comment and a rep for Jay-Z, 38, could not be reached, the courthouse trip is the first real indication that the pair – who first started dating in 2002 – will walk down the aisle.

Rumors of a wedding have long followed the couple, and Beyoncé has admitted to thinking about how it would happen. "I don't know when I'll want to get married," she told Cosmopolitan in January 2006. "I never pictured myself as a bride, but after my sister's wedding, I did start thinking about what kind of wedding I'd want. I don't think I want a big one."

A year later, she told InStyle, "Maybe me and my man will go away to an island; maybe we'll go to a church. I have no idea."

Beyoncé and Jay-Z Take Out Marriage License

Beyoncé Knowles and Jay-Z Photo by: James Devaney / WireImage

Beyonce Knowles and longtime beau Jay-Z have taken out a marriage license in Scarsdale, N.Y., PEOPLE has learned.

According to a source, the pair obtained a license Tuesday morning. The document is valid for 60 days.

A rep for Beyoncé told PEOPLE, "No comment." Jay-Z's spokesperson could not be reached.

Beyoncé, 26, and Jay-Z, 38, have been dating since 2002, though the couple have stood reluctant to discuss their relationship publicly. Rumors about their romance began circulating after the singer appeared on Jay-Z's song "'03 Bonnie & Clyde," followed by collaborations on Beyoncé's solo hit "Crazy in Love," in 2003.

While the two have remained tight-lipped about the state of their romance, by no means has Beyoné brushed off talk of marriage. In December 2006, the singer told InStyle, "You can't rush a man into anything – whether it's a relationship, marriage or having children."

Earlier that month the pair were besieged by rumors that they were all set to get hitched in the Caribbean – a rumor that was quickly scotched by their reps.

Jay - Z And Beyonce Officially Engaged
June 4, 2007 5:03 a.m. EST
Jordan Casey - AHN News Writer

Cannes, France (BANG) - Jay-Z has proposed to long-term love Beyonce Knowles.
The hip-hop star popped the question during a romantic getaway to Cannes, and the singer-and-actress said yes. The pair are now planning to marry in Hawaii in the fall.

Beyonce said: "I want to get married and really want a family - in a perfect world I'd have two boys and a girl. You know someone loves you by the way he treats you and respects you. Me and Jay respect each other."

Jay-Z flew to London on Sunday night to watch Beyonce perform at Wembley on the latest leg of her U.K. tour. The 38-year-old hip-hop mogul even canceled his own promotional tour of his business empire Roc-A-Fella to surprise his 26-year-old fiancee.

Sources say Jay-Z promised Beyonce "the biggest diamond she can fit on her finger."
A source said: "This will be the hip-hop wedding to end all hip-hop weddings."