It's definitely possible but it might be a bit tough. I'd say Electromagnetism will probably be much more important than linear algebra. You can check out 8.02 on OCW (http://ocw.mit.edu/courses/physics/8-02-electricity-and-magn...) which covers basically the same material as AP Physics but with more calculus and a higher level of difficulty of course. Good luck!