Let's take this one step more. Does one have to use a dot, a line, a squiggle, etc.? Is it possible to use marks that are much less reminiscent of music notation? Of course. For example, view some of the Antipodes Landscapes to see a select set of "rudiments" being used. So, instead of a paradiddle, roll, flam, or drag on a drum surface, I could apply a crescent void, raked lines, closed triangular (or near-triangular) shapes with a pattern fill, etc. to the drawing surface.
Enough for now.