https://www.whiterabbitpress.com/product.php?productid=16678&cat=250&page=4
White Rabbit Press has added to their inventory a counter book called 数え方の辞典 Kazoekata no Jiten (A Dictionary of Japanese Counters). This looks like a worthy addition to your own library although they caution it is in all Japanese.
From the sample page listed on their website, it looks like if you can read at least hiragana and katakana then you shouldn't have a problem using this book.
Update: found this book at a local bookstore here in Japan, and my Japanese friends were amazed by the book. They never knew such a thing existed! It certainly is going to be a worthy addition to my studies and learning.