Use all files ending in .ann in one directory as y1 and y2 values for Cohen's Kappa

I have two directories: 'ann-1' and 'ann-2', in these directories I have text files and .ann files. Is there a way I can use all .ann files from the first directory as the y1 value and all .ann files from the second directory as the y2 value?

sklearn.metrics.cohen_kappa_score(y1, y2, *, labels=None, weights=None, sample_weight=None)  

I'm really not sure if I even interpreted scikit's documentation correctly, as their documentation is not very detailed.

https://stackoverflow.com/questions/67384318/use-all-files-ending-in-ann-in-one-directory-as-y1-and-y2-values-for-cohens-ka May 04, 2021 at 07:57PM