The count is the number of users that match the criteria of that userlist. Since that's a language string yes you can change what it says or remove it entirely. The generic language key applied to all userlists for that string are as follows.
SITENAME_HAS_TOTAL_REGISTERED_MEMBERS
USERS_COUNT_MEMBERS
To override this on a per-userlist basis you'll need to use the below language keys.
USERLIST_userlist_id_here_TOTAL_REGISTERED_MEMBERS
USERLIST_userlist_id_here_COUNT_MEMBERS
Be sure to replace userlist_id_here with the actual id of your userlist. See the below on how to use language overrides within CB.
www.joomlapolis.com/blog/kyle/18701-language-overrides-have-arrived