Welcome to dbForumz.com!
FAQFAQ    SearchSearch      ProfileProfile    Private MessagesPrivate Messages   Log inLog in

Full Text search on one column might contain dramatically ..

 
   Database Forums (Home) -> Full Text RSS
Next:  Dealing with NULL in Contains  
Author Message
Dragonjoke

External


Since: Aug 15, 2008
Posts: 3



(Msg. 1) Posted: Fri Aug 15, 2008 3:18 pm
Post subject: Full Text search on one column might contain dramatically different languages
Archived from groups: microsoft>public>sqlserver>fulltext (more info?)

Dear All,

I have a table for storing text with different language (Chinese / English / Japanese.. etc) like this:

ID (int)
Lang (char(2))
Story (nvarchar(100))

How can I add full-text-search features on this [Story] for different language?

Regards,
Ken



--
Free News Reader
http://put.hk
http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html

 >> Stay informed about: Full Text search on one column might contain dramatically .. 
Back to top
Login to vote
Russell Fields

External


Since: Feb 21, 2007
Posts: 457



(Msg. 2) Posted: Fri Aug 15, 2008 3:18 pm
Post subject: Re: Full Text search on one column might contain dramatically different languages [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

Ken,

SQL Server full-text definitions are at the column level, not the row. So,
I do not believe that you can do as you ask. If you truly wanted to support
all features of the other languages, you would need to have separate
language tables or columns.

RLF

"Dragonjoke" wrote in message

> Dear All,
>
> I have a table for storing text with different language (Chinese / English
> / Japanese.. etc) like this:
>
> ID (int)
> Lang (char(2))
> Story (nvarchar(100))
>
> How can I add full-text-search features on this [Story] for different
> language?
>
> Regards,
> Ken
>
>
>
> --
> Free News Reader
> http://put.hk
> http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html
>
>
>

 >> Stay informed about: Full Text search on one column might contain dramatically .. 
Back to top
Login to vote
Dragonjoke

External


Since: Aug 15, 2008
Posts: 3



(Msg. 3) Posted: Sat Aug 16, 2008 11:46 am
Post subject: Re: Full Text search on one column might contain dramatically different languages [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

Thanks for your quick response.

Will change it to varbinary(Max) help? or change to XML type as describe in this article?

http://msdn.microsoft.com/en-us/library/ms142507.aspx

[quote]
For plain text content
When your content is plain text, you can convert it to the xml data type and add language tags that indicate the language corresponding to each specific document or document section. For this to work, however, you need to know the language before full-text indexing.
[/quote]

Regards,
Ken
--
Free News Reader
http://put.hk
http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html

Russell Fields wrote:
> Ken,
> SQL Server full-text definitions are at the column level, not the row. So,
> I do not believe that you can do as you ask. If you truly wanted to support
> all features of the other languages, you would need to have separate
> language tables or columns.
> RLF
> "Dragonjoke" wrote in message
>
> > Dear All,
> >
> > I have a table for storing text with different language (Chinese / English
> > / Japanese.. etc) like this:
> >
> > ID (int)
> > Lang (char(2))
> > Story (nvarchar(100))
> >
> > How can I add full-text-search features on this [Story] for different
> > language?
> >
> > Regards,
> > Ken
> >
> >
> >
> > --
> > Free News Reader
> > http://put.hk
> > http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html
> >
> >
> >
 >> Stay informed about: Full Text search on one column might contain dramatically .. 
Back to top
Login to vote
Dragonjoke

External


Since: Aug 15, 2008
Posts: 3



(Msg. 4) Posted: Sat Aug 16, 2008 12:01 pm
Post subject: Re: Full Text search on one column might contain dramatically different languages [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

Second question:

What if I just want to enable Full Text Search for 1 specify language, say Chinese? Any performance drawback (Both building index and sql enquiry) if there are only 1/4 rows of whole table is Chinese text?


--
Free News Reader
http://put.hk
http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html

Dragonjoke wrote:
> Thanks for your quick response.
> Will change it to varbinary(Max) help? or change to XML type as describe in this article?
> http://msdn.microsoft.com/en-us/library/ms142507.aspx
> [quote]
> For plain text content
> When your content is plain text, you can convert it to the xml data type and add language tags that indicate the language corresponding to each specific document or document section. For this to work, however, you need to know the language before full-text indexing.
> [/quote]
> Regards,
> Ken
> --
> Free News Reader
> http://put.hk
> http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html
> Russell Fields wrote:
> > Ken,
> > SQL Server full-text definitions are at the column level, not the row. So,
> > I do not believe that you can do as you ask. If you truly wanted to support
> > all features of the other languages, you would need to have separate
> > language tables or columns.
> > RLF
> > "Dragonjoke" wrote in message
> >
> > > Dear All,
> > >
> > > I have a table for storing text with different language (Chinese / English
> > > / Japanese.. etc) like this:
> > >
> > > ID (int)
> > > Lang (char(2))
> > > Story (nvarchar(100))
> > >
> > > How can I add full-text-search features on this [Story] for different
> > > language?
> > >
> > > Regards,
> > > Ken
> > >
> > >
> > >
> > > --
> > > Free News Reader
> > > http://put.hk
> > > http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html
> > >
> > >
> > >
 >> Stay informed about: Full Text search on one column might contain dramatically .. 
Back to top
Login to vote
Hilary Cotter3

External


Since: Aug 28, 2004
Posts: 1259



(Msg. 5) Posted: Wed Aug 20, 2008 7:11 am
Post subject: Re: Full Text search on one column might contain dramatically different languages [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

Word and XML have language aware tags in them. In XML you will have to add
them in Word they are automatically there.

Then when you index the content will be indexed according to the language
tags, no matter what you specified the word breaker language to be for the
table.

Now when you search you will need to specify the language in your query. The
problem is if you search on english words, and specify the chinese languge
in your query you will get documents in all languages. If you search on
Chinese word and specify the Chinese language in your query you will get
documents in all languges which contain those characters you are searching
on.

However, this will probably work for you.

"Dragonjoke" wrote in message

> Second question:
>
> What if I just want to enable Full Text Search for 1 specify language, say
> Chinese? Any performance drawback (Both building index and sql enquiry) if
> there are only 1/4 rows of whole table is Chinese text?
>
>
> --
> Free News Reader
> http://put.hk
> http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html
>
> Dragonjoke wrote:
>> Thanks for your quick response.
>> Will change it to varbinary(Max) help? or change to XML type as describe
>> in this article?
>> http://msdn.microsoft.com/en-us/library/ms142507.aspx
>> [quote]
>> For plain text content
>> When your content is plain text, you can convert it to the xml data type
>> and add language tags that indicate the language corresponding to each
>> specific document or document section. For this to work, however, you
>> need to know the language before full-text indexing.
>> [/quote]
>> Regards,
>> Ken
>> --
>> Free News Reader
>> http://put.hk
>> http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html
>> Russell Fields wrote:
>> > Ken,
>> > SQL Server full-text definitions are at the column level, not the row.
>> > So,
>> > I do not believe that you can do as you ask. If you truly wanted to
>> > support
>> > all features of the other languages, you would need to have separate
>> > language tables or columns.
>> > RLF
>> > "Dragonjoke" wrote in message
>> >
>> > > Dear All,
>> > >
>> > > I have a table for storing text with different language (Chinese /
>> > > English
>> > > / Japanese.. etc) like this:
>> > >
>> > > ID (int)
>> > > Lang (char(2))
>> > > Story (nvarchar(100))
>> > >
>> > > How can I add full-text-search features on this [Story] for different
>> > > language?
>> > >
>> > > Regards,
>> > > Ken
>> > >
>> > >
>> > >
>> > > --
>> > > Free News Reader
>> > > http://put.hk
>> > > http://put.hk/reader/news.microsoft.com/microsoft.public.sqlserver.fulltext.html
>> > >
>> > >
>> > >
>
>
 >> Stay informed about: Full Text search on one column might contain dramatically .. 
Back to top
Login to vote
Display posts from previous:   
   Database Forums (Home) -> Full Text All times are: Pacific Time (US & Canada)
Page 1 of 1

 
You can post new topics in this forum
You can reply to topics in this forum
You can edit your posts in this forum
You can delete your posts in this forum
You can vote in polls in this forum



[ Contact us | Terms of Service/Privacy Policy ]