[FIXED] Not able to scrape checkbox value from each table tr

Issue

Please see the below html table

<table width=900 cellspacing=0 border=0 cellpadding=5 style='border-top:1px solid silver;border-left:1px solid silver;border-right:1px solid silver;'>
    <tr >
        <td style='border-bottom:1px solid silver;background:#ffffff;'>
            <input checked type=checkbox name=jobs[] value='610974'>
                <table border=0 cellpadding=2 cellspacing=0 style='border:4px #70797a; border-radius: 5px;'>
                    <tr>
                        <td style='background:lightgreen;' valign=top>
                            <img src='../images/checkwhite.png' style='width:30px;'>
                            </td>
                            <td style='background:lightgreen;'> 123 Charter Rd Wethersfield CT  06109 &nbsp; &nbsp;  </td>
                            <tr>
                                <td>Your Input</td>
                                <td>123 CHARTER RD WETHERSFIELD CT 06109</td>
                            </tr>
                        </table>
                        <br clear=all>
                            <div style='margin-left:40px;'>09/11/2018 &nbsp; &nbsp; &nbsp; 
                                <br>Exterior BPO - Light Photo Set (3 photos*)  &nbsp; &nbsp; &nbsp; 
                                    <br>$9.00 &nbsp; &nbsp; &nbsp; We found a rep 6.2 miles from job.  &nbsp; &nbsp; &nbsp;  &nbsp; &nbsp; &nbsp; 
                                        <span style='color:silver'> 640x480  &nbsp; &nbsp; &nbsp; Add Datestamp, </span>
                                        <br clear=all>
                                            <div style=float:left;'></div>
                                        </div>
                                    </td>
                                </td>
                                <tr >
                                    <td style='border-bottom:1px solid silver;background:#ffffff;'>
                                        <div style='color:red; font-weight:bold; '>Warning... Duplicate Found!</div>
                                        <input checked type=checkbox name=jobs[] value='610975'>
                                            <table border=0 cellpadding=2 cellspacing=0 style='border:4px #70797a; border-radius: 5px;'>
                                                <tr>
                                                    <td style='background:lightgreen;' valign=top>
                                                        <img src='../images/checkwhite.png' style='width:30px;'>
                                                        </td>
                                                        <td style='background:lightgreen;'> 123 Charter Rd Wethersfield CT  06109 &nbsp; &nbsp;  </td>
                                                        <tr>
                                                            <td>Your Input</td>
                                                            <td>123 CHARTER RD WETHERSFIELD CT 06109</td>
                                                        </tr>
                                                    </table>
                                                    <br clear=all>
                                                        <div style='margin-left:40px;'>09/11/2018 &nbsp; &nbsp; &nbsp; 
                                                            <br>Exterior BPO - Light Photo Set (3 photos*)  &nbsp; &nbsp; &nbsp; 
                                                                <br>$9.00 &nbsp; &nbsp; &nbsp; We found a rep 6.2 miles from job.  &nbsp; &nbsp; &nbsp;  &nbsp; &nbsp; &nbsp; 
                                                                    <span style='color:silver'> 640x480  &nbsp; &nbsp; &nbsp; Add Datestamp, </span>
                                                                    <br clear=all>
                                                                        <div style=float:left;'>

I need the output as :

id="610974" and Address="123 CHARTER RD WETHERSFIELD CT 06109" [Ist checkbox value is id and corresponding address] id="610975" and Address="123 CHARTER RD WETHERSFIELD CT 06109" [Ist checkbox value is id and corresponding address] etc....

soup = BeautifulSoup(bodystrip, "lxml")
for tr in response.find_all('tr'):
       tds = tr.find_all('td')
       print(tds[0].text)
       jobid = tds[0].find('input')
       print(jobid)

this is getting error on address are properly getting

Solution

With Scrapy:

for input_node in response.xpath('//input[@name="jobs[]"]'):
    id = input_node.xpath(./@value).extract_first()
    address = input_node.xpath('./following-sibling::table[1]//td[.="Your Input"]/following-sibling::td[1]/text()').extract_first()

Answered By - gangabass