IIRC there was a tribe of Native Americans that used a numeric system that was octal... Which initially seems rather odd, until you find out how they were enumerating things -- they were using the spaces between the fingers, not the fingers themselves.

Now if you want rather awkward -- try performing arithmetic using Roman numerals... ugh...

... and on the lighter side of mathmatical discussion... How about that ancient Apraphullian rope computer?