Select the ticket capture channel on the page and click Add Statistics Task to start execution.

redis

mysql

1. Obtain the incoming ticket capture channel and obtain a list of all related capture strategies based on the ticket capture channel.

2. According to the queried crawling strategy list, obtain the whitelist list in the strategy list respectively.

3. According to the airline-route relationship list, the date is represented by * wildcard. According to the key rules, all the main keys under a ticket capture channel are spliced ​​together in batches at one time and stored in the set.

4. Use mget to set the main key to mget all keys in redis at once to obtain a return list.

5. Filter the returned list and group it by route

6. Generate statistical result data under this strategy and store it in the database