abforce,
Do not put any caps on the inputs to ground, that is what is giving you the triangle wave.
Remove them, and put a small cap, say 3-10 pF across R3, the feedback resistor.
The overshoot says your phase margin is low. Adding the CF should help.
Harry