{"id":2741,"date":"2023-11-19T16:26:01","date_gmt":"2023-11-19T16:26:01","guid":{"rendered":"https:\/\/rahulshettyacademy.com\/blog\/?p=2741"},"modified":"2023-12-03T06:54:26","modified_gmt":"2023-12-03T06:54:26","slug":"handle-webtables-in-selenium-webdriver","status":"publish","type":"post","link":"https:\/\/rahulshettyacademy.com\/blog\/index.php\/2023\/11\/19\/handle-webtables-in-selenium-webdriver\/","title":{"rendered":"Handle WebTables in Selenium Webdriver"},"content":{"rendered":"\n

Navigate to https:\/\/money.rediff.com\/index.html<\/a><\/p>\n\n\n\n

Click \u2018More gainers\u2019 link that you see in below figure<\/p>\n\n\n\n


You get a list of all the companies, see below figure<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

This is an example of Webtable, it is a kind of an excel file where elements are present in a systematic tabular manner.<\/p>\n\n\n\n

Right click & inspect this Webtable, you will see that this webtable is under \u2018<table><\/em>\u2019 tag<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

If you hover over <table<\/strong> class=\u201ddataTable\u201d><\/strong>, the entire Webtable is highlighted<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

So, table<\/em><\/strong> is the parent tag of all the webtables<\/p>\n\n\n\n

Inside the <table> tag we have 2 immediate child tags as shown below: thead<\/em><\/strong> and tbody<\/em><\/strong> <\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

When we expand the thead<\/strong> tag, we can see that it contains the tr<\/em><\/strong> <\/strong>tag (r<\/em><\/strong> <\/strong>stands for <\/strong>row<\/em><\/strong>)<\/strong><\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

When we mouse hover over tr<\/strong>, we would see entire first row getting highlighted, see below <\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Expand <tr> <\/strong>tag, it contains <th> <\/strong>tags (th <\/strong>for table headings<\/strong>)<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

When we mouse hover over any <th> tag, the respective table heading gets highlighted. <\/p>\n\n\n\n

For example, mouse hover <th>Current Price (Rs)<\/th><\/em>, notice that \u2018Current Price (Rs)<\/em>\u2019 column name gets highlighted

<\/p>\n\n\n\n

Similarly you can mouse hover other <th> tags.<\/p>\n\n\n\n

Now let us expand <tbody><\/strong> tag. It contains various tr <\/strong>tags corresponding to each row. So each tr<\/strong> tag represents table row. So if you mouse hover any tr<\/strong> tag, you see the respective company row getting highlighted, see below<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Let us expand <tr<\/strong>> tag. It contains td <\/strong>tag that holds the data of a particular cell. So if you mouse hover over <td>18.88<\/td>, you see that 18.88 getting highlighted<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Webtable hierarchy can thus be represented as below:<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Let us try to create few custom xpaths for the webtable.<\/p>\n\n\n\n

We earlier saw that the table <\/strong>tag has \u201cclass\u201d <\/strong>attribute having the value \u2018dataTable<\/strong>\u2019
<\/p>\n\n\n\n

Execute the below custom xpath in SelectorsHub<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n
\"\"\/<\/figure>\n\n\n\n

This will select the entire webtable as shown below<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n
\"\"\/<\/figure>\n\n\n\n

Let us now extend this custom xpath by appending tbody<\/strong> tag that in turn contains tr<\/strong> tag that in turn contains td<\/strong> tag<\/p>\n\n\n\n


See that all the rows and columns get highlighted<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Below xpath would highlight 5th<\/sup> cell data of 4th row <\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n
\"\"\/<\/figure>\n\n\n\n

Below xpath would highlight entire 4th row<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n
\"\"\/<\/figure>\n\n\n\n

Below xpath would highlight all the individual cells of 4th row<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n
\"\"\/<\/figure>\n\n\n\n

Below xpath represents all the rows<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n
\"\"\/<\/figure>\n\n\n\n

Let us say we want to print the \u2018Current price\u2019 of \u2018JK Lakshmi Cement L<\/em>\u2019

<\/em><\/strong>
<\/em><\/strong>
Let us copy the text \u2018JK Lakshmi Cement L<\/em>\u2019 from website page and create new class. Paste the company name in a string variable


Xpath of entire first column (company names) would be: <\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n


<\/strong>This will give us a list of all the companies<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Now we will extract all the values of first column (since first column gives us company name) using \u201cfindElement<\/em>s<\/em><\/strong>\u201d <\/strong>method that returns us a \u2018List\u2019 (we have to import java.util.List)<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n
\"\"\/<\/figure>\n\n\n\n

Let us use a \u2018for\u2019 loop to print all the values (company names) <\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Run script, all the company names are printed<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n


Similarly the xpath \/\/table[@class=’dataTable’]\/tbody\/tr\/td[4]<\/strong> will extract all the current prices (since column 4 gives us current price)<\/p>\n\n\n\n


So we can write


Now we can print each company & its corresponding current price<\/p>\n\n\n\n



Run, all companies along with their respective current prices get printed<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

We are only interested in \u2018JK Lakshmi Cement L<\/em>\u2019, so we can put a simple \u2018if\u2019 condition inside the \u2018for\u2019 loop. This \u2018if\u2019 condition will check, if the \u201ccName\u201d that we have defined in line#13 equals the \u201ccNames\u201d that we are fetching inside the \u2018for\u2019 loop. Once both match, we will print the o\/p<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

Run, notice that only desired value is printed <\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n
\"\"\/<\/figure>\n\n\n\n

Below is complete source code<\/p>\n\n\n\n

\"\"\/<\/figure>\n\n\n\n

This is how we can handle webtables using selenium webdriver. <\/p>\n\n\n\n

Thanks! <\/p>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

Navigate to https:\/\/money.rediff.com\/index.html Click \u2018More gainers\u2019 link that you see in below figure You get a list of all the companies, see below figure This is an example of Webtable, it is a kind of an excel file where elements are present in a systematic tabular manner. Right click & inspect this Webtable, you will […]<\/p>\n","protected":false},"author":1,"featured_media":1238,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[],"class_list":["post-2741","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-selenium","post-wrapper","thrv_wrapper"],"_links":{"self":[{"href":"https:\/\/rahulshettyacademy.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/2741","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rahulshettyacademy.com\/blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rahulshettyacademy.com\/blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/rahulshettyacademy.com\/blog\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/rahulshettyacademy.com\/blog\/index.php\/wp-json\/wp\/v2\/comments?post=2741"}],"version-history":[{"count":10,"href":"https:\/\/rahulshettyacademy.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/2741\/revisions"}],"predecessor-version":[{"id":2827,"href":"https:\/\/rahulshettyacademy.com\/blog\/index.php\/wp-json\/wp\/v2\/posts\/2741\/revisions\/2827"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/rahulshettyacademy.com\/blog\/index.php\/wp-json\/wp\/v2\/media\/1238"}],"wp:attachment":[{"href":"https:\/\/rahulshettyacademy.com\/blog\/index.php\/wp-json\/wp\/v2\/media?parent=2741"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rahulshettyacademy.com\/blog\/index.php\/wp-json\/wp\/v2\/categories?post=2741"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rahulshettyacademy.com\/blog\/index.php\/wp-json\/wp\/v2\/tags?post=2741"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}