Defender Chambers missed the Boxing Day draw at Bournemouth having picked up his fifth top-flight booking of the season.
Gabriel Martinelli will be assessed on the hamstring injury which kept him sidelined at the Vitality Stadium, while Rob Holding (knee), Sead Kolasinac (ankle) and Kieran Tierney (shoulder) are absent.
Alonso and James both missed out on the Blues' 2-0 home loss to Southampton on Boxing Day through injury and will be handed late fitness tests.
Arsenal provisional squad: Leno, Maitland-Niles, Luiz, Papastathopoulos, Saka, Torreira, Xhaka, Ozil, Nelson, Lacazette, Aubameyang, Martinez, Mustafi, Chambers, Bellerin, Mavropanos, Guendouzi, Willock, Smith Rowe, Martinelli, Pepe.
Chelsea provisional squad: Arrizabalaga, Zouma, Christensen, Rudiger, Tomori, Emerson, James, Azpilicueta, Alonso, Kovacic, Jorginho, Willian, Kante, Pulisic, Abraham, Hudson-Odoi, Mount, Batshuayi, Caballero, Gilmour, Barkley, Pedro, Giroud.