The annual ceremony came just months after Barack Obama became the first sitting US president to visit the city, paying moving tribute to victims of the first atomic bomb.
American B-29 bomber Enola Gay dropped its deadly payload, dubbed "Little Boy", on the western Japanese city at 8:15 am local time on August 6, 1945.
Much of the city was incinerated by a wall of heat up to 4,000 C (7,232 F) -- hot enough to melt steel -- killing tens of thousands.
"(His visit) was the proof that Hiroshima's strong wish not to tolerate the 'absolute evil' was shared by President Obama," he said.
"It is the time for us to make actions towards the abolition of the 'absolute evil', the ultimate form of inhumanity, united and with passion."
The bombing claimed the lives of 140,000 people. Some died immediately while others succumbed to injuries or radiation-related illnesses weeks, months and years later.
A second bomb destroyed the city of Nagasaki three days later. Japan announced its surrender in World War II on August 15.
But many Americans believe they hastened the end of a bloody conflict, and ultimately saved lives, thus justifying the bombings.
Obama in May embraced survivors as he made his historic visit to the city and its Hiroshima Peace Memorial Park.
"71 years ago, death fell from the sky and the world was changed," he said of the bomb, adding it "demonstrated that mankind possessed the means to destroy itself".
Obama offered no apology for the bombings, having insisted he would not revisit decisions made by then president Harry Truman.
Since Obama went to Hiroshima the park and accompanying memorial museum have witnessed an increase in visitors.
But an association of atomic bomb survivors has criticised his speech, saying he failed to explicitly mention US responsibility for the bombing.
Abe, who also attended the service, faced harsh criticism last year, especially from A-bomb survivors, for his policy of expanding the role of Japan's military and opening the door to possibly sending troops into combat for the first time since the war.
