Analyzing Features of Japanese Splogs and Characteristics of - - PowerPoint PPT Presentation

▶
analyzing features of japanese splogs and characteristics
SMART_READER_LITE
LIVE PREVIEW

Analyzing Features of Japanese Splogs and Characteristics of - - PowerPoint PPT Presentation

Oct 17, 2023 154 likes •627 views

Analyzing Features of Japanese Splogs and Characteristics of Keywords Yuuki Sato 1 Takehito Utsuro 1 Tomohiro Fukuhara 2 Yasuhide Kawada 3 Yoshiaki Murakami 3 Hiroshi Nakagawa 4 Noriko Kando 5 1 University of Tsukuba, 2,4 University of Tokyo, 3

slide-1
SLIDE 1

1

Analyzing Features of Japanese Splogs and Characteristics of Keywords

Yuuki Sato1 Takehito Utsuro1 Tomohiro Fukuhara2 Yasuhide Kawada3 Yoshiaki Murakami3 Hiroshi Nakagawa4 Noriko Kando5

1 University of Tsukuba, 2,4 University of Tokyo, 3 Navix Co., Ltd., 5 National Institute of Informatics

AIRWeb2008, April 22nd, 2008 @Beijing, CHINA. WWW2008

slide-2
SLIDE 2

2

Background (1/2)

  • Opinion Mining from Blogs
  • Splogs are Serious Noise in Opinion Mining

– e.g., larger scale statistics (2008 Mar.)

  • 40% of Japanese Blog Articles in BuzzPulse,

nifty are Splogs, 2007 Oct. 2008 Feb.

  • Automatic Detection is highly Expected.
slide-3
SLIDE 3

3

keyword stuffed blog

slide-4
SLIDE 4

4

Rumor of “Niigata” (a prefecture in Japan) “Niigata” Blog snippet retrieved with “Niigata”

slide-5
SLIDE 5

5

Blog snippet retrieved with “Azusa Yamamoto” (an actress) pop-up advertisement automatically inserted by the blog host system

slide-6
SLIDE 6

6

Background (1/2)

  • Opinion Mining from Blogs
  • Splogs are Serious Noise in Opinion Mining

– e.g., larger scale statistics (2008 Mar.)

  • 40% of Japanese Blog Articles in BuzzPulse,

nifty are Splogs, 2007 Oct. 2008 Feb.

  • Automatic Detection is highly Expected.
slide-7
SLIDE 7

7

Background (2/2)

  • for SEO, Spammers use certain Keywords

when Creating Splogs

Which keyword was chosen by spammers? Upper House election health food spammer splogs spammer splogs

  • up-to-date

topics

Splog rate

slide-8
SLIDE 8

8

$50 Software Package for Massive Splog Creation

Featuring

  • SEO
  • Affiliate Program

in link in link

satellite satellite satellite satellite satellite satellite main site

slide-9
SLIDE 9

9

Purpose of this Research

  • Manually Analyzing Correlation of Splogs / Splog rates and

Keywords included in Japanese Splogs

  • Features of Keywords
  • Representing a Topic by a Keyword
  • Topics of Public/Private Concerns
  • Duration Time of a Topic with / without Burst
  • Splog rate of Blog Sites including the Keyword
  • Features of Splogs
  • Affiliate / Content Source / Creation Procedure
  • Classifying Spammers into Professional / Amateur
slide-10
SLIDE 10

10

Purpose of this Research

  • Manually Analyzing Correlation of Splogs / Splog rates and

Keywords included in Japanese Splogs

  • Features of Keywords
  • Representing a Topic by a Keyword
  • Topics of Public/Private Concerns
  • Duration Time of a Topic with / without Burst
  • Splog rate of Blog Sites including the Keyword
  • Features of Splogs
  • Affiliate / Content Source / Creation Procedure
  • Classifying Spammers into Professional / Amateur
slide-11
SLIDE 11

11

Social Insurance Agency problem

  • Pension
  • Video
  • Rumor
  • Money-making
  • iPod

Wii Diet

  • Maker in the brain
  • Asashry
  • Urban legend
  • Shiroi-Koi-Bito

(White chocolate)

  • World Championships

in Athletics

  • Viagra
  • Net café Refugees
  • Fashion
  • Darvsh
  • Saeko
  • Kaori Manabe
  • Syoko Nakagawa
  • Leah Dizon
  • Chinatsu Wakatsuki
  • Democratic Party of Japan

Billy's Boot Camp

  • Adult
  • Mixi

ZARD Health food

  • No revision
  • Cosmetic surgery
  • China Airlines

Erog

  • COMSN, Inc.
  • The dignity of

the woman

  • Lazy woman
  • Youtube
  • Matsuoka, Minister of

Agriculture, Forestry and Fisheries

  • Gap-widening

society

  • Miwa Asao
  • Ogu-Shio
  • National High School

Baseball Championship

  • Harry Potter
  • Resignation
  • Miyazaki

prefecture

  • Liberal Democratic Party

North Korea Global warming Eco

  • Heat wave

Upper House election

Social interest Social Social problem Health Human Net work Beauty Scandal Sports Celebrity Gadget Celebrity Culture Health Internet

Public Concern Private Concern Duration: Long Term Duration: Short Term

slide-12
SLIDE 12

12

Purpose of this Research

  • Manually Analyzing Correlation of Splogs / Splog rates and

Keywords included in Japanese Splogs

  • Features of Keywords
  • Representing a Topic by a Keyword
  • Topics of Public/Private Concerns
  • Duration Time of a Topic with / without Burst
  • Splog rate of Blog Sites including the Keyword
  • Features of Splogs
  • Affiliate / Content Source / Creation Procedure
  • Classifying Spammers into Professional / Amateur
slide-13
SLIDE 13

13

Procedure of Collecting and Annotating Splogs

1. Selecting 50 sample keywords balanced on the map. 2. For each keyword, collecting blog site URLs including the keyword on its burst date. 3. Sampling blog site URLs including those with the most frequent posts. 4. Manual assignment of splog features and classifying splog/authentic blog.

slide-14
SLIDE 14

14

Social Insurance Agency problem

  • Pension
  • Video
  • Rumor
  • Money-making
  • iPod

Wii Diet

  • Maker in the brain
  • Asashry
  • Urban legend
  • Shiroi-Koi-Bito

(White chocolate)

  • World Championships

in Athletics

  • Viagra
  • Net café Refugees
  • Fashion
  • Darvsh
  • Saeko
  • Kaori Manabe
  • Syoko Nakagawa
  • Leah Dizon
  • Chinatsu Wakatsuki
  • Democratic Party of Japan

Billy's Boot Camp

  • Adult
  • Mixi

ZARD Health food

  • No revision
  • Cosmetic surgery
  • China Airlines

Erog

  • COMSN, Inc.
  • The dignity of

the woman

  • Lazy woman
  • Youtube
  • Matsuoka, Minister of

Agriculture, Forestry and Fisheries

  • Gap-widening

society

  • Miwa Asao
  • Ogu-Shio
  • National High School

Baseball Championship

  • Harry Potter
  • Resignation
  • Miyazaki

prefecture

  • Liberal Democratic Party

North Korea Global warming Eco

  • Heat wave

Upper House election

Social interest Social Social problem Health Human Net work Beauty Scandal Sports Celebrity Gadget Celebrity Culture Health Internet

Public Concern Private Concern Duration: Long Term Duration: Short Term

slide-15
SLIDE 15

15

Procedure of Collecting and Annotating Splogs

1. Selecting 50 sample keywords balanced on the map. 2. For each keyword, collecting blog site URLs including the keyword on its burst date. 3. Sampling blog site URLs including those with the most frequent posts. 4. Manual assignment of splog features and classifying splog/authentic blog.

slide-16
SLIDE 16

16

Collecting blog site URLs including the keyword on its burst date Burst Date

slide-17
SLIDE 17

17

Procedure of Collecting and Annotating Splogs

1. Selecting 50 sample keywords balanced on the map. 2. For each keyword, collecting blog site URLs including the keyword on its burst date. 3. Sampling blog site URLs including those with the most frequent posts. 4. Manual assignment of splog features and classifying splog/authentic blog.

slide-18
SLIDE 18

18

Features for Characterizing Splogs and Rate in Splogs

4.5% 11.5% 36.9% 49.5% 12.7% 3.6% 2.9% 27.1% 70.8% 14.3% 42.1% 8.1% 31.0% 80.5%

P5: automatically generated text P4: keyword stuffed blog P3: excerpt from other sources, retrieved with a single keyword throughout a blog homepage P2: excerpt from other sources, retrieved with a keyword varying day by day P1: excerpt from other sources, selected without keyword retrieval Creation Procedure Features S5: meaningless sequence of words S4: originally written texts S3: excerpt from advertisement pages S2: excerpt from blog articles (posts) or other web texts S1: excerpt from news articles Content Source Features A4: keywords with popup advertisement A3: articles (posts) with adult content A2: advertisement articles (posts) A1: links to affiliated sites Affiliate Features

slide-19
SLIDE 19

19

Manual Analysis of Splogs

  • Blog Host Distribution
  • Classifying Spammers into Professional / Amateur

– Analyzing Professional Spammers

  • Splog Features and Keywords
  • Correlation:

– Characteristics of Keywords:

  • Public / Private Concern

– Splog Rate per Keyword

  • Professional Spammer Rate
  • Amateur Only Splog Rate
slide-20
SLIDE 20

20

Manual Analysis of Splogs

  • Blog Host Distribution
  • Classifying Spammers into Professional / Amateur

– Analyzing Professional Spammers

  • Splog Features and Keywords
  • Correlation:

– Characteristics of Keywords:

  • Public / Private Concern

– Splog Rate per Keyword

  • Professional Spammer Rate
  • Amateur Only Splog Rate
slide-21
SLIDE 21

21

Splog Host Statistics (1/2)

  • for 22 / 50 keywords, 2145 blog sites
  • for the hosts S and C, splog rates

in our blog data set are around 50%, paying less costs of manually removing splogs.

1703 296 207 130 128 355 169 115 203 non splog 442 26 1 3 24 54 142 192 splog 20.6 8.7 0.0 0.8 2.3 6.3 24.2 55.3 48.6 splog rate(%) total rest Y G L A J C S Host

Splog Rate per Blog Host

slide-22
SLIDE 22

22

  • Splog Host Statistics (2/2)

Blog Host Distribution in Splogs

  • for 22 / 50 keywords,

2145 blog sites

  • 88% of splogs

from top-3 hosts (S,C,J)

slide-23
SLIDE 23

23

Manual Analysis of Splogs

  • Blog Host Distribution
  • Classifying Spammers into Professional / Amateur

– Analyzing Professional Spammers

  • Splog Features and Keywords
  • Correlation:

– Characteristics of Keywords:

  • Public / Private Concern

– Splog Rate per Keyword

  • Professional Spammer Rate
  • Amateur Only Splog Rate
slide-24
SLIDE 24

24

Professional / Amateur Spammers

Professional Spammer: who created more than splog sites in our data set. Amateur Spammer: who created only one splog site in our data set.

  • Professional Spammers are manually identified by

comparing the similarity of HTML structures.

  • 60% of Splogs are created

by 10 Professional Spammers

slide-25
SLIDE 25

25

10 Professional Spammers in our Splog Data Set

  • 272

(100%)

Total

Erog, health food, Viagra, cosmetic surgery,

  • 15

(5.5%) 7 10

Erog, Asasho-ryu, P1: selected without keyword retrieval S1: news articles, S2: blog or

  • ther web texts

A1: links to affiliated sites, A3: adult content, A4: popup advertisement

10 (3.7%) 6

health food P2: retrieved with a keyword varying day by day, P4: keyword stuffed blog S3: advertisement pages A1: links to affiliated sites, A2: advertisement articles

20 (7.4%) 5

national pension P2: retrieved with a keyword varying day by day S2: blog or other web texts, S3: advertisement pages A1: links to affiliated sites, A2: advertisement articles, A4: popup advertisement

26 (9.6%) 4

national pension, COMSN, Inc. P1: selected without keyword retrieval S1: news articles, S3: advertisement pages A1: links to affiliated sites

30 (11.0%) 3

Erog P2: retrieved with a keyword varying day by day S2: blog or other web texts A1: links to affiliated sites

56 (20.6%) 2 rumor, no revision, cosmetic surgery, Asasho-ryu, Saeko, China Airlines, COMSN, Inc., ZARD, heat wave, Wii, North Korea, “lazy woman”

P3: retrieved with a single keyword S2: blog or other web texts A1: links to affiliated sites, A4: popup advertisement

115 (42.3%) 1

keywords Creation Procedure Features Content Source Features Affiliate Features # of Splogs ID

slide-26
SLIDE 26

26

Manual Analysis of Splogs

  • Blog Host Distribution
  • Classifying Spammers into Professional / Amateur

– Analyzing Professional Spammers

  • Splog Features and Keywords
  • Correlation:

– Characteristics of Keywords:

  • Public / Private Concern

– Splog Rate per Keyword

  • Professional Spammer Rate
  • Amateur Only Splog Rate
slide-27
SLIDE 27

27

10 Professional Spammers in our Splog Data Set

  • 272

(100%)

Total

Erog, health food, Viagra, cosmetic surgery,

  • 15

(5.5%) 7 10

Erog, Asasho-ryu, P1: selected without keyword retrieval S1: news articles, S2: blog or

  • ther web texts

A1: links to affiliated sites, A3: adult content, A4: popup advertisement

10 (3.7%) 6

health food P2: retrieved with a keyword varying day by day, P4: keyword stuffed blog S3: advertisement pages A1: links to affiliated sites, A2: advertisement articles

20 (7.4%) 5

national pension P2: retrieved with a keyword varying day by day S2: blog or other web texts, S3: advertisement pages A1: links to affiliated sites, A2: advertisement articles, A4: popup advertisement

26 (9.6%) 4

national pension, COMSN, Inc. P1: selected without keyword retrieval S1: news articles, S3: advertisement pages A1: links to affiliated sites

30 (11.0%) 3

Erog P2: retrieved with a keyword varying day by day S2: blog or other web texts A1: links to affiliated sites

56 (20.6%) 2 rumor, no revision, cosmetic surgery, Asasho-ryu, Saeko, China Airlines, COMSN, Inc., ZARD, heat wave, Wii, North Korea, “lazy woman”

P3: retrieved with a single keyword S2: blog or other web texts A1: links to affiliated sites, A4: popup advertisement

115 (42.3%) 1

keywords Creation Procedure Features Content Source Features Affiliate Features # of Splogs ID

Splog of “rumor of X” type

slide-28
SLIDE 28

28

Rumor of “Niigata” (a prefecture in Japan) “Niigata” Blog snippet retrieved with “Niigata”

slide-29
SLIDE 29

29

10 Professional Spammers in our Splog Data Set

  • 272

(100%)

Total

Erog, health food, Viagra, cosmetic surgery,

  • 15

(5.5%) 7 10

Erog, Asasho-ryu, P1: selected without keyword retrieval S1: news articles, S2: blog or

  • ther web texts

A1: links to affiliated sites, A3: adult content, A4: popup advertisement

10 (3.7%) 6

health food P2: retrieved with a keyword varying day by day, P4: keyword stuffed blog S3: advertisement pages A1: links to affiliated sites, A2: advertisement articles

20 (7.4%) 5

national pension P2: retrieved with a keyword varying day by day S2: blog or other web texts, S3: advertisement pages A1: links to affiliated sites, A2: advertisement articles, A4: popup advertisement

26 (9.6%) 4

national pension, COMSN, Inc. P1: selected without keyword retrieval S1: news articles, S3: advertisement pages A1: links to affiliated sites

30 (11.0%) 3

Erog P2: retrieved with a keyword varying day by day S2: blog or other web texts A1: links to affiliated sites

56 (20.6%) 2 rumor, no revision, cosmetic surgery, Asasho-ryu, Saeko, China Airlines, COMSN, Inc., ZARD, heat wave, Wii, North Korea, “lazy woman”

P3: retrieved with a single keyword S2: blog or other web texts A1: links to affiliated sites, A4: popup advertisement

115 (42.3%) 1

keywords Creation Procedure Features Content Source Features Affiliate Features # of Splogs ID

  • Text content is excerpted from the news articles of the date
  • n which the splog article are created, without keyword retrieval.
  • Keywords with public concern, “national pension” and “Asasho-ryu” are

included in splogs.

slide-30
SLIDE 30

30

Manual Analysis of Splogs

  • Blog Host Distribution
  • Classifying Spammers into Professional / Amateur

– Analyzing Professional Spammers

  • Splog Features and Keywords
  • Correlation:

– Characteristics of Keywords:

  • Public / Private Concern

– Splog Rate per Keyword

  • Professional Spammer Rate
  • Amateur Only Splog Rate
slide-31
SLIDE 31

31 23.5%

0.0% 0.0% 1.8% 2.0% 2.8% 2.8% 2.9% 4.7% 4.7% 6.9%

14.3% 15.1% 15.2% 19.1% 22.1% 22.5% 24.4% 37.4% 40.9% 58.1% 88.1% 89.2% Splog rate ( splog / (splog + non-splog) ) (video) (health food) Total

(Democratic Party of Japan) (Upper House election) (slang word for “lazy woman”) (“The dignity of the woman”, book) (heat wave) (video game console) (North Korea) (China Airlines) (singer) (COMSN, Inc.)

(Saeko, Darvish’s wife) (Billy’s Boot Camp) (Asasho-ryu, sumo wrestler) (Darvish, baseball player) (Viagra) (comsmetic surgery) (no revision) (national pension) (rumor) (Erog, adult) Kewords

Splog Rate per Keyword: for 22 Keywords

90%30% 30%10%

slide-32
SLIDE 32

Social Insurance Agency problem

  • Pension
  • Video
  • Rumor
  • iPod

Wii Asashry

  • Viagra
  • Darvsh
  • Saeko
  • Democratic Party of Japan

Billy's Boot Camp

  • ZARD

Health food

  • No revision
  • Cosmetic surgery
  • Erog
  • COMSN, Inc.
  • The dignity of

the woman

  • Lazy woman
  • North Korea

Heat wave

Public Concern Private Concern

Duration: Long Term Duration: Short Term

  • China Airlines
  • Upper House election

red keywords: splog rate > 10% with box: splog rate > 30%

slide-33
SLIDE 33

33 most splogs from professional spammers

excerpts from blogs or ads / most splogs from professional spammers

Pension

  • Video
  • Rumor
  • iPod

Wii Asashry

  • Viagra
  • Darvsh
  • Saeko
  • Democratic Party of Japan

Billy's Boot Camp

  • ZARD

Health food

  • No revision
  • Cosmetic surgery
  • Erog
  • COMSN, Inc.
  • The dignity of

the woman

  • Lazy woman
  • North Korea

Heat wave

Public Concern Private Concern

Duration: Long Term Duration: Short Term

  • China Airlines
  • Upper House election

red keywords: splog rate > 10% with box: splog rate > 30%

Keywords with public concern are with low splog rates, but “national pension” and “Asasho-ryu” are exceptional, because of splogs created by professional spammers.

slide-34
SLIDE 34

34 23.5%

0.0% 0.0% 1.8% 2.0% 2.8% 2.8% 2.9% 4.7% 4.7% 6.9%

14.3% 15.1% 15.2% 19.1% 22.1% 22.5% 24.4% 37.4% 40.9% 58.1% 88.1% 89.2% Splog rate ( splog / (splog + non-splog) ) (video) (health food) Total

(Democratic Party of Japan) (Upper House election) (slang word for “lazy woman”) (“The dignity of the woman”, book) (heat wave) (video game console) (North Korea) (China Airlines) (singer) (COMSN, Inc.)

(Saeko, Darvish’s wife) (Billy’s Boot Camp) (Asasho-ryu, sumo wrestler) (Darvish, baseball player) (Viagra) (comsmetic surgery) (no revision) (national pension) (rumor) (Erog, adult) Kewords

Splog Rate per Keyword: for 22 Keywords

90%30% 30%10%

slide-35
SLIDE 35

35 61.5% 14.3% 0.0% 80.0% 0.0% 0.0% 11.1% 14.3% 58.7% 18.5% 90.2% 94.8% 92.4% Professional spammer rate ( from professional spammer / splog ) 23.5% 14.3% 15.1% 15.2% 19.1% 22.1% 22.5% 24.4% 37.4% 40.9% 58.1% 88.1% 89.2% Splog rate ( splog / (splog + non-splog) ) 19.1%

  • (video)

19.8% 5, 7 (health food) 9.0% 10 Groups Total of 22 keywords 12.2% 1

  • (Saeko, Darvish’s wife)

15.1%

  • (Billy’s Boot Camp)

3.4% 1, 6 (Asasho-ryu, sumo wrestler) 22.1%

  • (Darvish, baseball player)

20.5% 9 (Viagra) 21.7% 1, 10

  • (comsmetic surgery)

36.1% 1 (no revision) 12.0% 3, 4 (national pension) 27.8% 1 (rumor) 38.5% 2, 6, 8 (Erog, adult) Amateur Only splog rate ( from amateur spammer / ( from amateur spammer + non-splog) ) Professional Spammer ID Kewords

Splog Rate, Professional Spammer Rate, Amateur Only Splog Rate

slide-36
SLIDE 36

36 61.5% 14.3% 0.0% 80.0% 0.0% 0.0% 11.1% 14.3% 58.7% 18.5% 90.2% 94.8% 92.4% Professional spammer rate ( from professional spammer / splog ) 23.5% 14.3% 15.1% 15.2% 19.1% 22.1% 22.5% 24.4% 37.4% 40.9% 58.1% 88.1% 89.2% Splog rate ( splog / (splog + non-splog) ) 19.1%

  • (video)

19.8% 5, 7 (health food) 9.0% 10 Groups Total of 22 keywords 12.2% 1

  • (Saeko, Darvish’s wife)

15.1%

  • (Billy’s Boot Camp)

3.4% 1, 6 (Asasho-ryu, sumo wrestler) 22.1%

  • (Darvish, baseball player)

20.5% 9 (Viagra) 21.7% 1, 10

  • (comsmetic surgery)

36.1% 1 (no revision) 12.0% 3, 4 (national pension) 27.8% 1 (rumor) 38.5% 2, 6, 8 (Erog, adult) Amateur Only splog rate ( from amateur spammer / ( from amateur spammer + non-splog) ) Professional Spammer ID Kewords

Splog Rate, Professional Spammer Rate, Amateur Only Splog Rate

slide-37
SLIDE 37

37 61.5% 14.3% 0.0% 80.0% 0.0% 0.0% 11.1% 14.3% 58.7% 18.5% 90.2% 94.8% 92.4% Professional spammer rate ( from professional spammer / splog ) 23.5% 14.3% 15.1% 15.2% 19.1% 22.1% 22.5% 24.4% 37.4% 40.9% 58.1% 88.1% 89.2% Splog rate ( splog / (splog + non-splog) ) 19.1%

  • (video)

19.8% 5, 7 (health food) 9.0% 10 Groups Total of 22 keywords 12.2% 1

  • (Saeko, Darvish’s wife)

15.1%

  • (Billy’s Boot Camp)

3.4% 1, 6 (Asasho-ryu, sumo wrestler) 22.1%

  • (Darvish, baseball player)

20.5% 9 (Viagra) 21.7% 1, 10

  • (comsmetic surgery)

36.1% 1 (no revision) 12.0% 3, 4 (national pension) 27.8% 1 (rumor) 38.5% 2, 6, 8 (Erog, adult) Amateur Only splog rate ( from amateur spammer / ( from amateur spammer + non-splog) ) Professional Spammer ID Kewords

Splog Rate, Professional Spammer Rate, Amateur Only Splog Rate

slide-38
SLIDE 38

38 61.5% 14.3% 0.0% 80.0% 0.0% 0.0% 11.1% 14.3% 58.7% 18.5% 90.2% 94.8% 92.4% Professional spammer rate ( from professional spammer / splog ) 23.5% 14.3% 15.1% 15.2% 19.1% 22.1% 22.5% 24.4% 37.4% 40.9% 58.1% 88.1% 89.2% Splog rate ( splog / (splog + non-splog) ) 19.1%

  • (video)

19.8% 5, 7 (health food) 9.0% 10 Groups Total of 22 keywords 12.2% 1

  • (Saeko, Darvish’s wife)

15.1%

  • (Billy’s Boot Camp)

3.4% 1, 6 (Asasho-ryu, sumo wrestler) 22.1%

  • (Darvish, baseball player)

20.5% 9 (Viagra) 21.7% 1, 10

  • (comsmetic surgery)

36.1% 1 (no revision) 12.0% 3, 4 (national pension) 27.8% 1 (rumor) 38.5% 2, 6, 8 (Erog, adult) Amateur Only splog rate ( from amateur spammer / ( from amateur spammer + non-splog) ) Professional Spammer ID Kewords

Splog Rate, Professional Spammer Rate, Amateur Only Splog Rate

slide-39
SLIDE 39

39 61.5% 14.3% 0.0% 80.0% 0.0% 0.0% 11.1% 14.3% 58.7% 18.5% 90.2% 94.8% 92.4% Professional spammer rate ( from professional spammer / splog ) 23.5% 14.3% 15.1% 15.2% 19.1% 22.1% 22.5% 24.4% 37.4% 40.9% 58.1% 88.1% 89.2% Splog rate ( splog / (splog + non-splog) ) 19.1%

  • (video)

19.8% 5, 7 (health food) 9.0% 10 Groups Total of 22 keywords 12.2% 1

  • (Saeko, Darvish’s wife)

15.1%

  • (Billy’s Boot Camp)

3.4% 1, 6 (Asasho-ryu, sumo wrestler) 22.1%

  • (Darvish, baseball player)

20.5% 9 (Viagra) 21.7% 1, 10

  • (comsmetic surgery)

36.1% 1 (no revision) 12.0% 3, 4 (national pension) 27.8% 1 (rumor) 38.5% 2, 6, 8 (Erog, adult) Amateur Only splog rate ( from amateur spammer / ( from amateur spammer + non-splog) ) Professional Spammer ID Kewords

Splog Rate, Professional Spammer Rate, Amateur Only Splog Rate

Keywords with high splog rates are related to splogs from professional spammers.

slide-40
SLIDE 40

40 most splogs from professional spammers most splogs from professional spammers

Pension

  • Video
  • Rumor
  • iPod

Wii Asashry

  • Viagra
  • Darvsh
  • Saeko
  • Democratic Party of Japan

Billy's Boot Camp

  • ZARD

Health food

  • No revision
  • Cosmetic surgery
  • Erog
  • COMSN, Inc.
  • The dignity of

the woman

  • Lazy woman
  • North Korea

Heat wave

Public Concern Private Concern

Duration: Long Term Duration: Short Term

  • China Airlines
  • Upper House election

red keywords: splog rate > 10% with box: splog rate > 30%

slide-41
SLIDE 41

41 61.5% 14.3% 0.0% 80.0% 0.0% 0.0% 11.1% 14.3% 58.7% 18.5% 90.2% 94.8% 92.4% Professional spammer rate ( from professional spammer / splog ) 23.5% 14.3% 15.1% 15.2% 19.1% 22.1% 22.5% 24.4% 37.4% 40.9% 58.1% 88.1% 89.2% Splog rate ( splog / (splog + non-splog) ) 19.1%

  • (video)

19.8% 5, 7 (health food) 9.0% 10 Groups Total of 22 keywords 12.2% 1

  • (Saeko, Darvish’s wife)

15.1%

  • (Billy’s Boot Camp)

3.4% 1, 6 (Asasho-ryu, sumo wrestler) 22.1%

  • (Darvish, baseball player)

20.5% 9 (Viagra) 21.7% 1, 10

  • (comsmetic surgery)

36.1% 1 (no revision) 12.0% 3, 4 (national pension) 27.8% 1 (rumor) 38.5% 2, 6, 8 (Erog, adult) Amateur Only splog rate ( from amateur spammer / ( from amateur spammer + non-splog) ) Professional Spammer ID Kewords

Splog Rate, Professional Spammer Rate, Amateur Only Splog Rate

Keywords with high amateur only splog rates are those with private concern.

slide-42
SLIDE 42

Social Insurance Agency problem

  • Pension
  • Video
  • Rumor
  • iPod

Wii Asashry

  • Viagra
  • Darvsh
  • Saeko
  • Democratic Party of Japan

Billy's Boot Camp

  • ZARD

Health food

  • No revision
  • Cosmetic surgery
  • Erog
  • COMSN, Inc.
  • The dignity of

the woman

  • Lazy woman
  • North Korea

Heat wave

Public Concern Private Concern

Duration: Long Term Duration: Short Term

  • China Airlines
  • Upper House election

red keywords: splog rate > 10% with box: splog rate > 30%

slide-43
SLIDE 43

Social Insurance Agency problem

  • Pension
  • Video
  • Rumor
  • iPod

Wii Asashry

  • Viagra
  • Darvsh
  • Saeko
  • Democratic Party of Japan

Billy's Boot Camp

  • ZARD

Health food

  • No revision
  • Cosmetic surgery
  • Erog
  • COMSN, Inc.
  • The dignity of

the woman

  • Lazy woman
  • North Korea

Heat wave

Public Concern Private Concern

Duration: Long Term Duration: Short Term

  • China Airlines
  • Upper House election

red keywords: splog rate > 10% with box: splog rate > 30%

Keywords with high amateur only splog rates are those with private concern.

slide-44
SLIDE 44

44

Manual Analysis of Splogs: Summary

  • Blog Host DistributionTop-3 hosts cover 88% of Splogs
  • Classifying Spammers into Professional / Amateur

– Analyzing Professional Spammers10 Pro Spammers

  • Splog Features and Keywords
  • Correlation:

– Keywords with Public Concern have Low Splog Rate. – Keywords with Private Concern may have High Rate of Amateur Only Splogs.

slide-45
SLIDE 45

45

Future Works

  • Integration with previously studied features of splogs:
  • characteristic words in splogs,
  • in-degree/out-degree distributions,
  • ping time series.
  • Applying existing machine learning based

splog detection techniques, and developing a splog detector with high accuracy.

  • Semi-supervised framework of detecting splogs of

previously unobserved types.

slide-46
SLIDE 46

46

Thanks for your attention!