early 15c., "immediately, without delay, at once," from incontinent + -ly (2). From 1550s as "unchastely;" in reference to bodily discharges from 1847.
Entries linking to incontinently
incontinent adj.
late 14c., "wanting self-restraint," from Old French incontinent (14c.) or directly from Latin incontinentem (nominative incontinens) "immoderate, intemperate, not holding back," from in- "not, opposite of" (see in- (1)) + continens (see continent (adj.)).
Originally chiefly of sexual appetites. General sense of "unable to retain" is from 1640s; medical sense of "unable to control bowels or bladder, unable to restrain natural discharges from the body" is attested by 1828.
He was incontynent, and with fleschely lustes he consumyd alle his tyme. ["Speculum Sacerdotale," 15th century]
-ly 2
common adverbial suffix, forming from adjectives adverbs signifying "in a manner denoted by" the adjective, Middle English, from Old English -lice, from Proto-Germanic *-liko- (cognates: Old Frisian -like, Old Saxon -liko, Dutch -lijk, Old High German -licho, German -lich, Old Norse -liga, Gothic -leiko); see -ly (1). Cognate with lich, and identical with like (adj.).
Weekley notes as "curious" that Germanic uses a word essentially meaning "body" for the adverbial formation, while Romanic uses one meaning "mind" (as in French constamment from Latin constanti mente). The modern English form emerged in late Middle English, probably from influence of Old Norse -liga.