Yes, you'll need to write custom CSS to make it columns like that though. That functionality is of course not built in. Recommend first setting "Hide Empty Searches" and "Collapse Search Criteria" to "No" under Parameters > Search of your userlist to get rid of the collapsing functionality. Example CSS below to force a column display.
Code:
.cbUsersList > form {
display: -ms-flexbox;
display: flex;
-ms-flex-wrap: wrap;
flex-wrap: wrap;
}
.cbUsersList > form > .cbUserListTitle,
.cbUsersList > form > .cbUserListHead,
.cbUsersList > form > .cbUserListPagination {
-ms-flex: 0 0 100%;
flex: 0 0 100%;
max-width: 100%;
}
.cbUsersList > form > .cbUserListSearch {
-ms-flex: 0 0 33.33333333%;
flex: 0 0 33.33333333%;
max-width: 33.33333333%;
}
.cbUsersList > form > .cbUserListSearch > .cbUserListSearchTitle {
display: none;
}
.cbUsersList > form > #cbUserTable {
-ms-flex: 0 0 66.66666667%;
flex: 0 0 66.66666667%;
max-width: 66.66666667%;
}
The search criteria is using grid sizing of col-4 and the results grid sizing of col-8. This uses Bootstrap 4 sizes, but as it's just plain CSS you can adjust it to whatever you like. The scrolling behavior is something you'd need to implement specific to your site in addition to other styling improvements.