Table fragmentation refers to the physical memory consumed by memory management data structures like page tables, segment tables, or allocation maps. This overhead is necessary for virtual memory translation but reduces available memory for actual processes.