Idea And Website Advice
Discussion
Hi guys,
Looking for a bit of advice about a project/idae I have... But I'll start off by saying I have no really knowledge about coding or making any sort of web page outside of Wordpress
But have as much time as I want and willing to learn how to do it myself as I go along.
My basic idea is to make a site that you can search for what you want (Like ebay, autotrader etc etc.... Where you can pick what you want, brand, make, size, price and distance away etc) But I want my site be a 'hub' one site you can go to, to search for what you want and will search all the site with relevance to the product you have searched for. And give you all the results for the related products you searched for with out going through the 10-20+ different sites entering in all the details.
So basically I want to make a site with a similar interface as ebay, autotrader etc. But will search multiple sites and give you the results in one place.
Sorry If it does make much sense but don't want to give to much away. Just looking for a bit of advice on where would be best to start and if its even possible...
Looking for a bit of advice about a project/idae I have... But I'll start off by saying I have no really knowledge about coding or making any sort of web page outside of Wordpress
But have as much time as I want and willing to learn how to do it myself as I go along.My basic idea is to make a site that you can search for what you want (Like ebay, autotrader etc etc.... Where you can pick what you want, brand, make, size, price and distance away etc) But I want my site be a 'hub' one site you can go to, to search for what you want and will search all the site with relevance to the product you have searched for. And give you all the results for the related products you searched for with out going through the 10-20+ different sites entering in all the details.
So basically I want to make a site with a similar interface as ebay, autotrader etc. But will search multiple sites and give you the results in one place.
Sorry If it does make much sense but don't want to give to much away. Just looking for a bit of advice on where would be best to start and if its even possible...

Kind of but not really, have read into that and basically making a search engine running off goggle and you can choose the sites/content you want it to search but not sure it will work for this...
I mean for more a niche/specialised searches. Where the interface is like autotrader and here, with pull down menus. But will search multiple sites and will list the results the autotrader and here on my site and will be linked to the original site. The market am aiming for will be used/second hand goods, if that makes it easier to understand what I want to do.
I mean for more a niche/specialised searches. Where the interface is like autotrader and here, with pull down menus. But will search multiple sites and will list the results the autotrader and here on my site and will be linked to the original site. The market am aiming for will be used/second hand goods, if that makes it easier to understand what I want to do.
http://www.ebizmba.com/articles/shopping-websites
Maybe these have yet to hit the UK but there's maaaaaaaaaany over here (USA).
Maybe these have yet to hit the UK but there's maaaaaaaaaany over here (USA).
fatbutt said:
http://www.ebizmba.com/articles/shopping-websites
Maybe these have yet to hit the UK but there's maaaaaaaaaany over here (USA).
Not really what am looking for and there are a few similar price comparison sites in the UK. Maybe these have yet to hit the UK but there's maaaaaaaaaany over here (USA).
Anyone got any advice on where I can start looking into coding and how to go about starting etc have had a search myself but there far to much to take in at once.... I need a starting point

Like I said it's going to be a side project with no real time scale, so can take my time and willing to learn

Wise said:
Not really what am looking for and there are a few similar price comparison sites in the UK.
Anyone got any advice on where I can start looking into coding and how to go about starting etc have had a search myself but there far to much to take in at once.... I need a starting point
Like I said it's going to be a side project with no real time scale, so can take my time and willing to learn
If you're struggling to explain what your concept is then you may struggle to get your message across as to how your site is 'not just another price comparison site'. As for coding, no-one really 'codes' anymore; they use software such as dreamweaver to do all that for them.Anyone got any advice on where I can start looking into coding and how to go about starting etc have had a search myself but there far to much to take in at once.... I need a starting point

Like I said it's going to be a side project with no real time scale, so can take my time and willing to learn

http://en.wikipedia.org/wiki/Adobe_Dreamweaver
Edited by anonymous-user on Wednesday 14th August 15:08
I know what you mean, I know what I want and dont want to give to much away as as far as I know there in not a similar site, well at least in the UK anyway.
Basic out line is. I want an imput interface like on here and autotrader etc. with pull down menus. Make, price, distance etc...
It will list all the results like ebay or similar. Then when you click the product it will take you to the original site it is being sold on.
So it is basically a comparison site.
Basic out line is. I want an imput interface like on here and autotrader etc. with pull down menus. Make, price, distance etc...
It will list all the results like ebay or similar. Then when you click the product it will take you to the original site it is being sold on.
So it is basically a comparison site.
Dreamweaver isn't too bad as a wysiwyg tool for someone creating basic sites without specific HTML or CSS knowledge, but as soon as you run into a display problem that only happens on certain browsers at certain sizes, you're going to need to be able to sort it out and DW (or any of the others) won't help there. You can build just as good a site with Notepad, or the free Notepad++, once you have the grasp of it. There are probably professional (expensive) tools available to manage code libraries, but it's early for that.
But that's not the OPs problem. I think the trouble will be getting the data from the other sites. The larger ones will probably have some kind of API to access their catalogue, but the smaller ones won't unless they are built on a platform that does that automatically. You also need to make sure that when you're sending visitors off to these sites, that you get an affiliate fee back from them - that's where the money will come from.
But that's not the OPs problem. I think the trouble will be getting the data from the other sites. The larger ones will probably have some kind of API to access their catalogue, but the smaller ones won't unless they are built on a platform that does that automatically. You also need to make sure that when you're sending visitors off to these sites, that you get an affiliate fee back from them - that's where the money will come from.
droopsnoot said:
You also need to make sure that when you're sending visitors off to these sites, that you get an affiliate fee back from them - that's where the money will come from.
Do you know how to go about getting an affiliate fee or setting it up with a smaller company/supplier. E.g. one that is not signed up to an affiliate program like affilinet? I assume the OP would be interested - and I certainly would 
esvcg said:
oh yes they do, and alot!
Also for clarity, dreamweaver is just a tool for entering in code. if you cant code or program, then youll have no luck using any package for this purpose, be it dreamweaver or others.
coding is usually conserned with front end, i.e. html/css to create the pages you see.
If you cant create custom themes for wordpress then you cant code.
developing/programming is different and runs the backend, i.e. database, how stuff actually works
If you cant write custom modules for wordpress, then you cant program.
There's a crucial difference between being a click monkey and a coder or developer!
Ok, to clarify, the majority of sites made are made with software such as dreamweaver. Sure, there are still those that code (and I'm sure they code 'a lot') but what I'm saying is that you don't need to know java or whatever to create a website. Its not like in the 90's when you had to know HTML.Also for clarity, dreamweaver is just a tool for entering in code. if you cant code or program, then youll have no luck using any package for this purpose, be it dreamweaver or others.
coding is usually conserned with front end, i.e. html/css to create the pages you see.
If you cant create custom themes for wordpress then you cant code.
developing/programming is different and runs the backend, i.e. database, how stuff actually works
If you cant write custom modules for wordpress, then you cant program.
There's a crucial difference between being a click monkey and a coder or developer!
Edited by esvcg on Wednesday 14th August 16:14
fatbutt said:
esvcg said:
oh yes they do, and alot!
Also for clarity, dreamweaver is just a tool for entering in code. if you cant code or program, then youll have no luck using any package for this purpose, be it dreamweaver or others.
coding is usually conserned with front end, i.e. html/css to create the pages you see.
If you cant create custom themes for wordpress then you cant code.
developing/programming is different and runs the backend, i.e. database, how stuff actually works
If you cant write custom modules for wordpress, then you cant program.
There's a crucial difference between being a click monkey and a coder or developer!
Ok, to clarify, the majority of sites made are made with software such as dreamweaver. Sure, there are still those that code (and I'm sure they code 'a lot') but what I'm saying is that you don't need to know java or whatever to create a website. Its not like in the 90's when you had to know HTML.Also for clarity, dreamweaver is just a tool for entering in code. if you cant code or program, then youll have no luck using any package for this purpose, be it dreamweaver or others.
coding is usually conserned with front end, i.e. html/css to create the pages you see.
If you cant create custom themes for wordpress then you cant code.
developing/programming is different and runs the backend, i.e. database, how stuff actually works
If you cant write custom modules for wordpress, then you cant program.
There's a crucial difference between being a click monkey and a coder or developer!
Edited by esvcg on Wednesday 14th August 16:14
Now for the site in question this is not an easy task. There are a few parts that need to be considered:
How the site will look and how you interact with it: This part is probably the easiest to learn, requires you to learn HTML/CSS and most likely some Javascript.
From this knowledge you should be able to create a mockup of the site.
The back end code: Now we are onto what some people deem "real programming". This is going to cover how to you get the data from other websites. This could be done a number of ways. Ideally by interacting with the remote site's API (Application Programming Interface) so you can make a request to them with the search criteria and they hand you back the results.
Not all sites have an API though, so for these you will need to "scrape" the site and extract everything. However every time they change the layout of the site your code may need to be updated. This could turn into a full time job pretty quickly.
Your choice of languages here could be any of Ruby, Python, PHP, Java, etc. If you've never done any programming before I would probably say go for Ruby + Ruby on Rails. Excellent support community and there are a plethora of ways to host it for free to start with.
So now you can take your mockup and create something that goes off and searches one or two websites.
Storage Pretty quickly you'll need to start storing stuff in a database (MySQL or PostgreSQL) to save searches, user login details etc... You could also start storing the details of the products in there for sites that allow you access to a complete list of products. However I would refrain from doing this for as long as you can and make the requests in real time where ever possible.
I could go on to the next stages but there is no point at all in worrying about those until you've got something working as above. For sites like you describe no one designs the whole thing any more. They start off with a minimal set of requirements, get that working, then decide what to do next.
Could you do the above with no prior programming experience? As long as you are willing to learn then of course you can. I've seen people do it before. Just take your time and enjoy the learning process and expect to keep re-writing your code. When developing any website or program you should follow these three steps at any stage:
1. Make it work
2. Make it elegant (i.e. tidy up your code and method)
3. Make it faster when required.
esvcg said:
to add to advice above:
1. Make it work
2. Make it elegant (i.e. tidy up your code and method)
3. Make it faster when required.
4. If you make time estimates, the actual time will be at least twice as long
5. Scale slowly, better to start with a small working project, than a big pile of poo
6. Plan early for the future1. Make it work
2. Make it elegant (i.e. tidy up your code and method)
3. Make it faster when required.
4. If you make time estimates, the actual time will be at least twice as long
5. Scale slowly, better to start with a small working project, than a big pile of poo
7. Make it flexible to take into account scaling (linked to 3)
8. Anticipate potential changes in the way other sites work/the market functions.
fatbutt said:
Ok, to clarify, the majority of sites made are made with software such as dreamweaver.
The only time we've even looked at Dreamweaver was when the least techie of our team (me) wanted to generate some documents in HTML (cleaner than M$ could output) to save the rest of the guys a bit of work.Not one of our techies has ever asked for it - dependent on what they're doing, they work from pretty much the same mix as Cornet outlines.
Before you need to worry yourself about coding, you need to make sure you actually have an idea that will work and make you some money.
As others have said, you don't seem to be able to distinguish this site from any of the price comparison sites out there. What is your USP?
Also, from a technical stand point, this isn't so easy. Either you're going to have a s
t tonne of data input, in order to populate a database with all the different items, colours, sizes, variations, etc. Or you require a website that is clever enough to scrape other websites and work out what the products are, then work out what the product models are, then work out what all the different variations of that product model are. In addition to that this system of yours would have to de-dupe a lot of data and match up slight discrepancies in product data between websites.
This is not a cheap system to do well.
Then what is your plan for marketing? First off you'll be competing with Google Shopping listings, eBay and Amazon. How do you plan to compete with them?
Lastly, look at The Lean Startup (book by Eric Reis), you should be able to find a number of websites about the methodology. It makes you validate your business ideas incrementally and stops you from wasting a lot of money.
As others have said, you don't seem to be able to distinguish this site from any of the price comparison sites out there. What is your USP?
Also, from a technical stand point, this isn't so easy. Either you're going to have a s
t tonne of data input, in order to populate a database with all the different items, colours, sizes, variations, etc. Or you require a website that is clever enough to scrape other websites and work out what the products are, then work out what the product models are, then work out what all the different variations of that product model are. In addition to that this system of yours would have to de-dupe a lot of data and match up slight discrepancies in product data between websites.This is not a cheap system to do well.
Then what is your plan for marketing? First off you'll be competing with Google Shopping listings, eBay and Amazon. How do you plan to compete with them?
Lastly, look at The Lean Startup (book by Eric Reis), you should be able to find a number of websites about the methodology. It makes you validate your business ideas incrementally and stops you from wasting a lot of money.
Cheers for all the advice guy, it's being a really helpful.
I do have a rough business plan/idea just now, but I am just starting to play about online trying to make money through affiliates etc. As a bit of a side project, when I had this idea which is going to be a really long term project... I know its going to be difficult and a steep learning curve
Basically it is going to be price comparison, but it's in a niche that gets a lot of traffic and will solve problems that I know loads of people have. The way I plan on making money will be through affiliates and ad space when there is even traffic going though the site. But it is in the very early stages and am trying to refine the idea, before I go a head. Just making sure it's going to actually be doable to get the data from the other sites etc.
As for scraping the data from the other sites, will I need some sort of software or coding to do that? Sorry for all the silly questions. Just trying to get an idea of how much work is actually going to be involved.
I do have a rough business plan/idea just now, but I am just starting to play about online trying to make money through affiliates etc. As a bit of a side project, when I had this idea which is going to be a really long term project... I know its going to be difficult and a steep learning curve

Basically it is going to be price comparison, but it's in a niche that gets a lot of traffic and will solve problems that I know loads of people have. The way I plan on making money will be through affiliates and ad space when there is even traffic going though the site. But it is in the very early stages and am trying to refine the idea, before I go a head. Just making sure it's going to actually be doable to get the data from the other sites etc.
As for scraping the data from the other sites, will I need some sort of software or coding to do that? Sorry for all the silly questions. Just trying to get an idea of how much work is actually going to be involved.
Wise said:
As for scraping the data from the other sites, will I need some sort of software or coding to do that? Sorry for all the silly questions. Just trying to get an idea of how much work is actually going to be involved.
The only way I could think of doing this would be to have some code that connects to the site in the same way that a browser does, and have it then scan the downloaded page for the data. This is why you have to keep watch on the sites you are scraping - as soon as they change the page layout, you have to change your scraper code to look for different data. With a lot of modern sites making extensive use of javascript to mozzerS said:
Do you know how to go about getting an affiliate fee or setting it up with a smaller company/supplier. E.g. one that is not signed up to an affiliate program like affilinet? I assume the OP would be interested - and I certainly would 
No, sorry. If you approach the company directly, it might be that the only reason they're not on an affiliate program is because they haven't thought of it, or didn't think anyone would be interested. I added it to a site I worked on because people showed an interest, and most smaller sites would be the same.
Gassing Station | Business | Top of Page | What's New | My Stuff


