"It takes a month to learn, but a lifetime to master"
The CQWP in SharePoint 2010 supports querying multi-value lookup fields against a single list or single-value lookup fields in multiple lists, but it does not support querying multi-value lookup fields against multiple lists.