Almost every physics journal will contain articles with information-theoretic connections when appropriate, such as Physical Review A and Journal of Statistical Physics. The following journals are either devoted to information theory or regularly contain applications of interest.
Acta Informatica
Cybernetica
Cybernetics and Systems
IEEE Transactions on Information Theory
Information and Computation
I.R.E. Professional Group on Information Theory
Open Systems and Information Dynamics