o'clock adj.

fifteenth letter of the alphabet, from a character that in Phoenician was called  'ain (literally "eye") and represented "a very peculiar and to us unpronounceable guttural" [Century Dictionary]. The Greeks also lacked the sound, so when they adopted the Phoenician letters they arbitrarily changed O's value to a vowel. (Thus there is no grounds for the belief that the form of the letter represents the shape of the mouth in pronouncing it.) The Greeks later added a special character for "long" O (omega), and the original became "little o" (omicron).

In Middle English and later colloquial use, o or o' can be an abbreviation of on or of, and is still literary in some words (o'clock, Jack-o'-lantern, tam-o'-shanter, cat-o'-nine-tails, will-o'-the-wisp, etc.).

O' the common prefix in Irish surnames is from Irish ó, ua (Old Irish au, ui) "descendant." 

The "connective" -o- is the usual connecting vowel in compounds taken or formed from Greek, where it often is the vowel in the stem. "[I]t is affixed, not only to terms of Greek origin, but also to those derived from Latin (Latin compounds of which would have been formed with the L. connecting or reduced thematic vowel, -i), especially when compounds are wanted with a sense that Latin composition, even if possible, would not warrant, but which would be authorized by the principles of Greek composition." [OED]

As "zero" in Arabic numerals it is attested from c. 1600, from the similarity of shape. Similarly the O blood type (1926) was originally "zero," denoting the absence of A and B agglutinogens.

As a gauge of track in model railroads, by 1905. For o as an interjection of fear, surprise, joy, etc., see oh.

The use of the colloquial or slang -o suffix in wino, ammo, combo, kiddo, the names of the Marx Brothers, etc., "is widespread in English-speaking countries but nowhere more so than in Australia" [OED].

"machine to measure and indicate time mechanically" (since late 1940s also electronically), late 14c., clokke, originally "clock with bells," probably from Middle Dutch clocke (Dutch klok) "a clock," from Old North French cloque (Old French cloke, Modern French cloche "a bell"), from Medieval Latin clocca "bell," which probably is from Celtic (compare Old Irish clocc, Welsh cloch, Manx clagg "a bell") and spread by Irish missionaries (unless the Celtic words are from Latin). Ultimately of imitative origin.

Wherever it actually arose, it was prob. echoic, imitating the rattling made by the early handbells of sheet-iron and quadrilateral shape, rather than the ringing of the cast circular bells of later date. [OED]

Replaced Old English dægmæl, from dæg "day" + mæl "measure, mark" (see meal (n.1)). The Latin word was horologium (source of French horologe, Spanish reloj, Italian oriolo, orologio); the Greeks used a water-clock (klepsydra, literally "water thief;" see clepsydra).

The image of put (or set) the clock back "return to an earlier state or system" is from 1862. Round-the-clock (adj.) is from 1943, originally in reference to air raids. To have a face that would stop a clock "be very ugly" is from 1886. (Variations from c. 1890 include break a mirror, kill chickens.)

I remember I remember

That boarding house forlorn,

The little window where the smell

Of hash came in the morn.

I mind the broken looking-glass,

The mattress like a rock,

The servant-girl from County Clare,

Whose face would stop a clock.

[... etc.; The Insurance Journal, January 1886]