This code file: crawl4ai/web_crawler.py needs minor changes

[vignesh1507]

1. Redundant kwargs in fetch_pages: The kwargs being passed in executor.map seem redundant, as they are being unpacked in the same format for every call. You can simplify this by passing **kwargs directly to the fetch_page_wrapper.

2. Potential for None Values in process_html: When calling process_html, if html is None (for instance, if the crawl fails), you may run into issues. Ensure that html is valid before passing it to process_html.

3. Missing import json: You use json.dumps in your code but haven't imported the json module. Make sure to add this import at the top:

import json

[vignesh1507]

#134 fixed the code.