Infrastructure and arrangement:
Arranging cricket games is a complex issue. The grounds need to be specifically made with the pitch needing special attention. The pitch should be of highest quality and should ensure a fair contest between the bat and the ball. Traditionally the host nations often prepare pitches according to the strengths of their own team and so the Olympic Committee might come under pressure when it comes to preparing sporting pitches.
Moreover, no other game can be played in the cricket ground as it can change the pitch conditions or hamper the ground. Now few countries will be willing to build a separate stadium for a game that is still trying to become a global sport.