User-agent: *

Disallow: *?
Disallow: */page/
Disallow: /wp-
Disallow: *.pdf

Allow: */uploads/
Allow: */themes/