The weather in late September can range from warm during the day (highs of about 18 degrees Celsius), to chilly at night (lows of about 10-12 degrees), so yes, dressing in layers is exactly what you should plan to do. Warm hoodies and shorts! Pants or jeans for the evenings.
It does rain from time to time, so definitely pack your rain gear.
Enjoy your trip!