Yes, the impact of removing all the organisms in a trophic level will be different for different trophic levels. For example, on removing producers; herbivores would not be able to survive or they would migrate and ecosystem would collapse. If herbivores are removed, producers would grow unchecked and carnivores would not get food. If carnivores are removed, herbivores would increase to unsustainable levels and could destroy the producers. If decomposers are removed, the dead animals would pile up due to which the environment would become polluted. In addition to this, if dead animals will not decompose, the recycling of nutrients in the soil will be stopped and its fertility will be reduced. As a result the green cover of the earth will be lost. Thus to maintain the balance of the ecosystem the presence of organisms is necessary at each trophic level.