README.md

# SpiderMan

**SpiderMan,a fast high-level web crawling & scraping framework for Elixir.**

inspired by [Crawly](https://github.com/elixir-crawly/crawly)(Elixir) and [Scrapy]()(Python).

## Installation

adding `spider_man` to your list of dependencies in `mix.exs`:

```elixir
def deps do
  [
    {:spider_man, "~> 0.2"}
  ]
end
```

## License

`spider_man` source code is released under Apache 2 License. Check the [LICENSE](./LICENSE) file for more information.