Ozil has yet to appear since the restart and Guendouzi was dropped by manager Mikel Arteta after the defeat at Brighton.
Midfielder Maddison has a hip problem while England left-back Chilwell has a foot injury.
Chilwell was replaced by Wolves loanee Ryan Bennett in Saturday's 3-0 win over Crystal Palace and he and Maddison will be assessed ahead of the game in London.
Arsenal provisional squad: Martinez, Macey, Bellerin, Soares, Sokratis, Luiz, Holding, Mustafi, Kolasinac, Tierney, Xhaka, Torreira, Ceballos, Maitland-Niles, Willock, Nelson, Pepe, Aubameyang, Lacazette, Nketiah, Saka.
Leicester provisional squad: Schmeichel, Ward, Justin, Evans, Chilwell, Fuchs, Soyuncu, Bennett, Morgan, Barnes, Tielemans, Mendy, Perez, Maddison, Ndidi, Choudhury, Praet, Albrighton, Gray, Iheanacho, Vardy.