База сайтов Similarweb 2.4КК (2018) + Bonus

Складчина: База сайтов Similarweb 2.4КК (2018) + Bonus

Формат данных: текстовые файлы с разделителем (.csv) с возможностью импорта в Excel для дальнейшего использования.
Имена файлов содержат раздел и категорию.

Список разделов с количеством записей:

Categories	Records
Adult	57 700
Arts and Entertainment	219 000
Autos and Vehicles	77 500
Beauty and Fitness	9 600
Books and Literature	7 400
Business and Industry	709 600
Career and Education	122 100
Computer and Electronics	78 200
Finance	32 600
Food and Drink	57 600
Gambling	3 900
Games	25 100
Health	101 500
Home and Garden	6 500
Internet and Telecom	98 600
Law and Government	43 800
News and Media	72 100
People and Society	177 400
Pets and Animals	19 400
Recreation and Hobbies	19 200
Reference	15 200
Science	25 700
Shopping	232 200
Sports	83 600
Travel	117 200

Спойлер: Список всех категорий с количеством записей

File name	Records
adult.csv	57700
arts_and_entertainment.csv	95020
arts_and_entertainment@animation_and_comics.csv	3990
[email protected]	1190
[email protected]	20
arts_and_entertainment@celebrities_and_entertainment_news.csv	1310
arts_and_entertainment@fashion_and_modeling.csv	1150
[email protected]	2480
[email protected]	10440
arts_and_entertainment@music_and_audio.csv	59750
arts_and_entertainment@performing_arts.csv	9500
[email protected]	14000
arts_and_entertainment@tv_and_video.csv	8850
arts_and_entertainment@visual_arts_and_design.csv	11300
autos_and_vehicles.csv	36820
autos_and_vehicles@automotive_industry.csv	10570
autos_and_vehicles@automotive_news.csv	140
[email protected]	2070
[email protected]	1210
autos_and_vehicles@car_buying.csv	14300
autos_and_vehicles@car_rentals.csv	1860
autos_and_vehicles@makes_and_models.csv	1400
[email protected]	5960
[email protected]	2880
autos_and_vehicles@trains_and_railroads.csv	300
beauty_and_fitness.csv	550
[email protected]	3240
[email protected]	1020
[email protected]	360
[email protected]	3080
[email protected]	460
beauty_and_fitness@skin_care.csv	490
beauty_and_fitness@weight_loss.csv	390
books_and_literature.csv	6880
books_and_literature@book_retailers.csv	200
[email protected]	230
[email protected]	20
books_and_literature@guides_and_reviews.csv	80
business_and_industry.csv	482580
business_and_industry@aerospace_and_defence.csv	520
business_and_industry@agriculture_and_forestry.csv	4120
[email protected]	540
business_and_industry@biotechnology_and_pharmaceuticals.csv	1150
business_and_industry@business_services.csv	14530
[email protected]	1590
business_and_industry@construction_and_maintenance.csv	50900
business_and_industry@customer_service.csv	100
[email protected]	310
[email protected]	6370
business_and_industry@industrial_goods_and_services.csv	28360
business_and_industry@marketing_and_advertising.csv	53780
business_and_industry@metals_and_mining.csv	760
business_and_industry@publishing_and_printing.csv	4670
business_and_industry@real_estate.csv	38130
business_and_industry@textiles_and_nonwovens.csv	2690
business_and_industry@transportation_and_logistics.csv	18420
business_and_industry@wholesale_trade.csv	60
career_and_education.csv	4340
career_and_education@business_training.csv	400
[email protected]	94400
career_and_education@human_resources.csv	100
career_and_education@jobs_and_employment.csv	12310
career_and_education@universities_and_colleges.csv	10610
computer_and_electronics.csv	14730
computer_and_electronics@computer_hardware.csv	4940
computer_and_electronics@computer_security.csv	1450
computer_and_electronics@consumer_electronics.csv	3290
computer_and_electronics@graphics_and_multimedia_tools.csv	1770
[email protected]	110
[email protected]	10820
[email protected]	41140
finance.csv	2300
[email protected]	2530
[email protected]	5560
finance@credit,_loans_and_mortgages.csv	1270
finance@financial_management.csv	10320
finance@grants_and_scholarships.csv	80
[email protected]	3320
[email protected]	7180
food_and_drink.csv	15350
[email protected]	4360
[email protected]	910
food_and_drink@cooking_and_recipes.csv	8940
food_and_drink@food_and_grocery_retailers.csv	6000
food_and_drink@restaurants_and_delivery.csv	21740
food_and_drink@vegetarian_and_vegan.csv	320
gambling.csv	480
[email protected]	190
[email protected]	1070
[email protected]	770
[email protected]	570
gambling@regulation_and_organizations.csv	0
[email protected]	850
games.csv	5440
games@board_and_card_games.csv	1100
[email protected]	110
[email protected]	2200
games@puzzles_and_brainteasers.csv	310
[email protected]	410
games@video_games.csv	15540
health.csv	58400
[email protected]	1240
health@alternative_and_natural_medicine.csv	6520
health@child_health.csv	120
health@conditions_and_diseases.csv	3750
[email protected]	4310
health@education_and_resources.csv	70
health@healthcare_industry.csv	2320
[email protected]	10150
health@mens_health.csv	20
health@mental_health.csv	3020
[email protected]	1030
[email protected]	300
health@products_and_shopping.csv	7320
health@public_health_and_safety.csv	1910
health@reproductive_health.csv	600
health@senior_health.csv	340
health@womens_health.csv	60
home_and_garden.csv	400
[email protected]	3100
home_and_garden@home_improvement.csv	560
home_and_garden@interior_decor.csv	70
home_and_garden@moving_and_relocating.csv	10
home_and_garden@nursery_and_playroom.csv	2400
internet_and_telecom.csv	49030
internet_and_telecom@ad_network.csv	110
internet_and_telecom@chats_and_forums.csv	7750
internet_and_telecom@domain_names_and_register.csv	1700
[email protected]	2500
internet_and_telecom@file_sharing.csv	1110
internet_and_telecom@mobile_developers.csv	1250
internet_and_telecom@online_marketing.csv	6380
internet_and_telecom@search_engine.csv	4210
internet_and_telecom@social_network.csv	3060
[email protected]	10060
internet_and_telecom@web_design.csv	4060
internet_and_telecom@web_hosting.csv	7380
law_and_government.csv	1520
[email protected]	25880
law_and_government@immigration_and_visas.csv	150
[email protected]	14630
law_and_government@military_and_defense.csv	1630
news_and_media.csv	61440
news_and_media@business_news.csv	200
news_and_media@college_and_university_press.csv	130
news_and_media@magazines_and_e-zines.csv	1490
[email protected]	3100
news_and_media@sports_news.csv	270
news_and_media@technology_news.csv	4040
[email protected]	1450
people_and_society.csv	92480
people_and_society@crime_and_prosecution.csv	120
[email protected]	870
people_and_society@disabled_and_special_needs.csv	400
people_and_society@gay,_lesbian,_and_bisexual.csv	1010
[email protected]	1670
[email protected]	1680
[email protected]	230
[email protected]	1990
[email protected]	360
people_and_society@relationships_and_dating.csv	3300
people_and_society@religion_and_spirituality.csv	72400
people_and_society@womens_interests.csv	920
pets_and_animals.csv	830
pets_and_animals@animal_products_and_service.csv	5330
[email protected]	600
pets_and_animals@fish_and_aquaria.csv	600
[email protected]	50
[email protected]	12030
recreation_and_hobbies.csv	670
[email protected]	50
[email protected]	640
[email protected]	750
[email protected]	890
[email protected]	1910
[email protected]	720
[email protected]	160
[email protected]	9920
[email protected]	630
recreation_and_hobbies@theme_parks.csv	330
[email protected]	510
[email protected]	2020
reference.csv	370
[email protected]	130
reference@ask_an_expert.csv	40
reference@dictionaries_and_encyclopedias.csv	7110
[email protected]	200
reference@libraries_and_museums.csv	5340
[email protected]	2000
science.csv	3800
[email protected]	250
[email protected]	1020
[email protected]	2320
[email protected]	440
science@earth_sciences.csv	660
science@educational_resources.csv	40
science@engineering_and_technology.csv	1000
[email protected]	3120
science@instruments_and_supplies.csv	170
[email protected]	890
[email protected]	310
science@social_sciences.csv	11660
shopping.csv	124790
shopping@antiques_and_collectibles.csv	1440
[email protected]	910
[email protected]	2480
[email protected]	4500
[email protected]	24430
shopping@consumer_electronics.csv	17200
[email protected]	1380
shopping@ethnic_and_regional.csv	80
[email protected]	2030
[email protected]	3910
shopping@general_merchandise.csv	1100
[email protected]	1380
shopping@home_and_garden.csv	23260
[email protected]	6590
[email protected]	840
shopping@office_products.csv	690
[email protected]	2610
[email protected]	10840
[email protected]	1710
sports.csv	47220
[email protected]	620
[email protected]	870
[email protected]	150
sports@cycling_and_biking.csv	4260
[email protected]	2430
sports@extreme_sports.csv	60
sports@fantasy_sports.csv	100
[email protected]	1130
[email protected]	900
[email protected]	5190
sports@martial_arts.csv	4940
[email protected]	50
[email protected]	1360
[email protected]	8720
[email protected]	940
[email protected]	370
sports@water_sports.csv	2790
sports@winter_sports.csv	1430
travel.csv	10840
travel@accommodation_and_hotels.csv	58100
travel@airlines_and_airports.csv	1220
travel@roads_and_highways.csv	500
[email protected]	46610

Записи содержат следующие поля (если таковые присутствовали):

1. SiteName
2. Category
3. GlobalRank
4. CountryRank
5. CategoryRank
6. Country
7. Engagments.Visits
8. Engagments.TimeOnSite
9. Engagments.PagePerVisit
10. Engagments.BounceRate
11. TrafficSources.Search
12. TrafficSources.Social
13. TrafficSources.Mail
14. TrafficSources.PaidReferrals
15. TrafficSources.Direct
16. TrafficSources.Referrals
17. SearchRatio

Спойлер: Пример записи

Код:

escortfr.net~Adult~255258~11461~13750~France~88538~550~13~9~15~0~0~0~84~1~15
beneluxxx.com~Adult~485742~7896~22698~Belgium~55948~163~6~33~50~1~1~0~23~25~50
niamodel.com~Adult~136759~9990~8414~France~388731~114~3~67~52~0~0~0~24~24~52
sexemodel.com~Adult~8879~286~673~France~3382563~488~18~19~54~1~1~0~42~2~54
nethomo.com~Adult~1479197~67389~52047~Poland~25153~210~3~36~2~0~0~0~97~1~2
pokaza.net~Adult~2045937~507858~65079~Russian Federation~17640~49~2~53~30~0~1~0~68~2~30
allporngames.com~Adult~24961172~1107822~387396~Australia~295~454~2~0~0~0~0~0~0~0~None
playporngames.xxx~Adult~653817~305842~28464~Germany~60356~109~3~46~86~0~0~0~9~5~86
sexyhumorgames.com~Adult~1072866~597773~41183~United States~40407~68~2~63~4~0~0~0~15~81~4
fuckporngames.com~Adult~21714999~9564703~348110~United States~350~71~2~54~0~0~0~0~34~66~None
ultraporngames.com~Adult~27666585~2045437~419936~Italy~245~26~2~66~0~0~0~0~100~0~None
xnxx.com~Adult~11~8~2~United States~2737927215~866~12~18~59~2~0~0~38~2~59
empflix.com~Adult~1075~310~83~Germany~49360467~150~3~42~10~1~0~0~14~75~10
fap.to~Adult~25003~10714~1845~United States~2906720~212~2~67~34~0~0~0~34~31~34
tnaflix.com~Adult~492~472~32~United States~88417985~200~3~44~23~1~0~0~17~59~23
pichunter.com~Adult~1821~1047~132~United States~13308388~338~18~41~71~1~0~0~25~3~71
wankspider.com~Adult~189330~112959~10938~United States~267419~140~3~63~18~0~0~0~23~59~18
xxxdessert.com~Adult~17031~10408~1272~United States~3176916~208~5~44~38~1~0~1~15~45~38
dumparump.com~Adult~151272~29255~9119~Germany~187161~230~10~38~5~0~0~0~35~59~5
tiava.com~Adult~14418~6894~1065~United States~3039408~652~8~22~25~0~0~0~72~3~25
sex.com~Adult~1059~755~80~United States~28327718~378~10~41~44~3~1~0~48~5~44
freeones.com~Adult~1574~823~116~United States~19052976~336~11~33~60~1~0~0~29~9~60
voyeurweb.com~Adult~9368~3414~705~United States~3967752~254~10~40~39~1~1~0~49~10~39
pocket-movie.net~Adult~317511~18842~16332~Japan~127828~141~4~43~0~0~0~0~0~100~None

БОНУС
В качестве бонуса предлагаю дамп базы MongoDB со всеми полями, которые отдавал донор.
+ Некоторые записи содержат дополнительные сведения от Semrush, WebArchive и технологии определяемые Wappalyzer-ом.

Спойлер: Пример полной записи из Монги

PHP:

<?php
{
    "_id" : ObjectId("5b103b1e01f4681534aa3402"),
    "SiteName" : "gilsmethod.com",
    "similarweb" : {
        "SiteName" : "gilsmethod.com",
        "Category" : 70,
        "GlobalRank" : 643532,
        "CountryRank" : 272807,
        "CategoryRank" : 13224,
        "EstimatedMonthlyVisits" : {
            "2017-11-01" : 55313,
            "2017-12-01" : 62745,
            "2018-01-01" : 195100,
            "2018-02-01" : 68898,
            "2018-03-01" : 68895,
            "2018-04-01" : 82401
        },
        "Engagments" : {
            "Year" : 2018,
            "Month" : 4,
            "Visits" : 82402,
            "TimeOnSite" : 28,
            "PagePerVisit" : 1,
            "BounceRate" : 80
        },
        "TopCountryShares" : [
            {
                "Country" : 840,
                "Value" : 38
            },
            {
                "Country" : 356,
                "Value" : 6
            },
            {
                "Country" : 124,
                "Value" : 6
            },
            {
                "Country" : 826,
                "Value" : 6
            },
            {
                "Country" : 36,
                "Value" : 3
            }
        ],
        "TrafficSources" : {
            "Search" : 94,
            "Social" : 0,
            "Mail" : 0,
            "Paid Referrals" : 0,
            "Direct" : 6,
            "Referrals" : 0
        },
        "TopDestinations" : [
            {
                "Site" : "lvbprint.de",
                "Value" : 22
            },
            {
                "Site" : "gilsmethod.wpengine.netdna-cdn.com",
                "Value" : 18
            },
            {
                "Site" : "videolan.org",
                "Value" : 10
            },
            {
                "Site" : "foxitsoftware.com",
                "Value" : 10
            },
            {
                "Site" : "imageresizer.codeplex.com",
                "Value" : 9
            }
        ],
        "TotalDestinations" : 13,
        "SearchRatio" : 94,
        "TopOrganicKeywords" : [
            "convert m4a to mp3",
            "convert m4a to mp3 vlc",
            "transcribe voice memos",
            "keyword ligttromm export",
            "mp4 to mp3"
        ],
        "OrganicKeywordsRollingUniqueCount" : 384,
        "OrganicSearchShare" : 100,
        "TopSocial" : [
            {
                "Site" : "facebook.com",
                "Value" : 100
            }
        ],
        "SimilarSites" : [
            "lifehacker.com",
            "howtogeek.com",
            "teknobites.com",
            "techrepublic.com",
            "pcnineoneone.com",
            "technipages.com",
            "makeuseof.com",
            "freepctech.com"
        ],
        "SimilarSitesByRank" : [
            "facebook.com",
            "microsoft.com",
            "lifehacker.com",
            "howtogeek.com",
            "makeuseof.com",
            "zdnet.com",
            "techrepublic.com",
            "macworld.com",
            "krebsonsecurity.com",
            "hardocp.com"
        ],
        "Country" : 840,
        "last_modified" : ISODate("2018-05-31T18:12:54.858Z")
    },
    "wappalyzer" : {
        "technology" : [
            "WordPress",
            "jQuery Migrate",
            "Google Font API",
            "Google AdSense",
            "jQuery",
            "MySQL",
            "PHP",
            "Nginx"
        ],
        "last_modified" : ISODate("2018-06-01T15:58:12.125Z")
    },
    "semrush_links" : {
        "links" : 24,
        "links_hostname" : 26,
        "links_domain" : 4133,
        "last_modified" : ISODate("2018-06-02T14:28:08.521Z")
    },
    "semrush_summary" : {
        "visits" : 73835,
        "date" : "2018-04-01",
        "domain" : "gilsmethod.com",
        "users" : 67564,
        "rank" : 202196,
        "social" : 1748,
        "direct" : 2559,
        "referral" : 2511,
        "paid" : 0,
        "bounce_rate" : 81,
        "time_on_site" : 77,
        "search" : 67017,
        "pages" : 1,
        "padded" : false,
        "last_modified" : ISODate("2018-06-02T14:28:08.779Z")
    },
    "webarchive" : {
        "last_ts" : "2018-02-24",
        "first_ts" : "2006-02-21",
        "years" : [
            "2016",
            "2017",
            "2018",
            "2006",
            "2007",
            "2008",
            "2009",
            "2010",
            "2011",
            "2012",
            "2013",
            "2014",
            "2015"
        ],
        "last_modified" : ISODate("2018-06-02T14:28:10.240Z")
    }
}

wappalyzer: 828 039
webarchive: 235 050
semrush_links: 236 690
semrush_summary: 20 250

Условия для получения бонуса стандартные. Подпись или 3 рекламных поста без нарушения правил.

Прошу обратить внимание!
Предоставляемые данные были собраны в середине предыдущего года. Если вы считаете, что актуальность ожидаемой вами информации чувствительна к порогу более десяти месяцев – настоятельно не рекомендую приобретать данный продукт.

 

Резерв

 

Готов взять на проверку...развернутый отзыв гарантирую

 

Это для SEOшнтков база, а не для спаммеров

 

Это рефлекс складчика. Вижу базу, электронную почту, телефон, id в вк - всё под спам

 

возьму на проверку

 

Далеко не факт)
Я как спамер, сразу для себя выгоду вижу)

 

Просто нужна база SEOшников

 

Также готов проверить

 

Почему это нет. Вон даже по тому же дейту 57 000 сайтов. Выбирай из списка нужный, находи уязвимости, автоматизируй и спамь себе сколько влезет.
С уважением.

 

Базу получил на проверку....ВЕЩЬ!=)))
Изучаю....на самом деле самое главное в этой складчине - это бонус. Хорошо когда знаешь как сортировать по такой базе.
Идёт общение с автором....

Проверять надо много чего....к сожалению надо готовиться к командировке.....но с меня отзыв по любому - материал действительно уникален, не вхожу в приватные сообщества - чтобы судить про перепродажу....но в текущем аспекте -материал уникален

Постараюсь в течении недели сделать отзыв.

 

в подписи

 

В подписи

 

В подписи!

 

в подписи

 

В подписи

 

В подписи

 

В подписи

 

В подписи