text:
6 bedroom equestrian facility for sale New Mill Lane, Forest Town, MansfieldA MAGNIFICENT GRADE II LISTED COUNTRY HOME WITH FANTASTIC EQUESTRIAN FACILITIES AND A RANGE OF OUTBUILDINGS SET WITHIN 50 ACRES OF LAND More details ›
£725,000 Offers in Region of
Offers in Region of £725,000
6 bedroom detached house for sale Northfield Avenue, MansfieldIN A LEAGUE OF IT'S OWN!...A truly special and individually designed six bedroomed detached family home located in this quite simply stunning location with beautiful far reaching open view. Set in a breathtaking plot that provides luxury both inside and out with quality fixtures and fittings ... More details ›
5 bedroom detached house for sale Springwood Drive,Mansfield WoodhouseWhat a fantastic opportunity to buy this superbly presented 5 bedroom detached family home at the head of a quiet cul-de-sac. Gardens to front and rear with detached brick double garage and driveway accommodating up to six cars we urge early viewing! Within easy assess to Mansfield town centre. More details ›
Added on 22/04/2015 by Need 2 View, Mansfield. Call: 01623 377088 Local call rate
5 bedroom detached house for sale St. James Gardens, Mansfield Woodhouse** AN EXTENDED MODERN DETACHED FAMILY HOME BORDERING FARMLAND WITH FANTASTIC OPEN VIEWS TO THE REAR, SITUATED ON A SMALL CUL-DE-SAC DEVELOPMENT ** SPACIOUS ACCOMMODATION WITH FIVE BEDROOMS, TWO EN SUITES + SAUNA, FOUR RECEPTION ROOMS + CONSERVATORY WITH UNDER FLOOR HEATING ** HIGH SPECIFICATION F... More details ›
Reduced on 28/07/2015 by Richard Watkinson & Partners, Mansfield. Call: 01623 377018 Local call rate
5 bedroom detached house for sale Arun Dale, Mansfield, Nottinghamshire, NG19HouseSimple is pleased to present this extended and upgraded, luxury 5 bedroom Detached House in Mansfield. More details ›
Added on 18/08/2015 by Housesimple Online Estate Agents, Nationwide. Call: 03301 110070 Local call rate
5 bedroom detached house for sale Belmont Close, Mansfield Woodhouse, Mansfield, NottinghamshireFrank Innes are delighted to present this uniquely designed five bedroom, three reception family home. Built in 1990 by the current owners this beautiful property really must be viewed to appreciate both its desirable location and uniquely designed interior. (contd...) More details ›
£230,000 Guide Price
Guide Price £230,000
10 bedroom detached house for sale Station Street, Mansfield Woodhouse, Mansfield, NottinghamshireA fantastic opportunity to acquire this 10 bedroom detached house, previously the New Inn public house on Station Street Mansfield Woodhouse. (contd...) More details ›
£199,500 Offers in Excess of
Offers in Excess of £199,500
5 bedroom detached house for sale Wells Close, Mansfield WoodhouseA substantial, extended five bedroom detached property where further planning permission has been granted for additional accommodation. This ideal family home includes gas central heating, upvc double glazing and comprises entrance porch, hallway, through lounge/dining room and fitted breakfast k... More details ›
£180,000 Offers Over
Offers Over £180,000
5 bedroom detached house for sale Sherwood Rise, Mansfield Woodhouse, MANSFIELD, NottinghamshireThis deceptively large FIVE bedroom detached house is located in Mansfield Woodhouse. Close to local amenities such as shops, bus routes, Rebecca Aldington Swimming centre and a short walk into the town centre. The property briefly comprises of an entrance hallway, lounge, kitchen/diner, downstai... More details ›
5 bedroom detached house for sale Denton Close, Forest Town, Mansfield, NottinghamshireNo upward chain is offered on this five bedroom detached house. Fantastic family house with spacious living accommodation and private enclosed garden. Close to good school catchment. (contd...) More details ›
- 1
Thank you.
Your information has been sent to 0 out of 9 agents who have property to sell in the area you specified.


text:
Buyers who searched magic cube jumpsuit reviews also searched: stylish pant striped jumpsuits stretch denim jumpsuit stylish overalls black short romper summer bodysuit black sleeveless jumpsuit stretch catsuit striped jumpsuit View More
Aliexpress magic cube jumpsuit Reviews
Aliexpress is the best place to come to find useful magic cube jumpsuit reviews. You can read the most in-depth reviews, ratings and feedbacks from people who have bought and used them. We have real consumer reviews of different types of magic cube jumpsuit, including magic cube game reviews, magic cube clothing reviews and more. Our magic cube jumpsuit reviews will help you make the best purchase.
magic cube jumpsuit Related Products With Reviews
MAGIC CUBE girls baby Summer bright drill romper tutu jumpsuitsSummary: Department Name: Baby ; Item Type: Bodysuits ; Pattern Type: Patchwork ; Brand Name: China manufacture productsUS $52.00 / lot
6 pieces / lotFree Shipping
Previous 1 Next

subset: commoncrawl


text:
Marie McDaniel
Marie McDaniel
JACKSBORO — Marie McDaniel, 71, died Tuesday January 7, 2014. Services will be 2 p.m. Thursday, at Coker Funeral Home Chapel with Bro. Dale Osteen Officiating.
Burial will be in Wesley Chapel Cemetery under the direction of the Funeral Home.
Survivors include, daughter, Crystal Morris; son, Terry McDaniel; sister Charlotte Marshall of Jacksboro, and four grandchildren.
Memorials may be made to Concerned Citizens, 400 East Pine Street, Jacksboro, Texas 76458.
Subscribe to the Times Record News
Ready to subscribe to the Times Record News? Choose between a Premium or Digital subscription below.
Need Help? Call us at 1-877-710-6181.
Monday-Friday: 5:30am-8pm / Saturday: 6am-1pm / Sunday: 6am-1pm


text:
Neoseeker : Games : Nintendo Wii : Virtual Console : Action : Super Star Wars
cheats | faqs | screens | forums | friendcodes
BackgroundSuper Star Wars is a VC game based upon the original on the SNES. There's five different characters to choose from in the great battle for control over the galaxy. It's an adaption of the plot of the older three films, though with an alternative spin where Luke isn't exactly looking to bring about peace!
Game Play
Hardware Info
Recent threads
- WHAT! Nov 25
- Opinions Aug 21
- Can you help me. Jul 18
Duncan Idaho
Oct 22, 14 6:53am
A flawed game that aimed to do too much
Super Star Wars is a side scroller/3rd Person shooter/Race game that was developed for the SNES by...
- Genre: Action (Wii VC)
- Theme(s): Alternate Reality, Fantasy, Sci-Fi (Futuristic)
- Perspective(s): Flat side view
- Developer: Sculptured Software Inc.
- Publisher: LucasArts
Released North America Aug 10, 2009
Star Wars Series
- Star Wars: Battlefront
- Star Wars: Knights of the Fallen Empire
- Star Wars 1313
- Star Wars: The Old Republic
- Star Wars: Knights of the Old Republic
- Star Wars Jedi Knight: Jedi Academy
- Star Wars Jedi Knight II: Jedi Outcast
- Star Wars Jedi Knight: Dark Forces II


text:
Comments by Blu
I like Bay and Emmett but I'm enjoying Noah too. Especially his predicament with his hearing. I loved the subtle bits thrown in, his hearing is continuing to decline, which was hinted at when she tried talking to him in the hallway and he still is too scared to tell more than just Bay the truth. Its interesting to watch.
Travis is troubled, yes, but the rejection that kid faces is disheartening. I was more distraught over the fact that Daphne was using him to prove to herself that she can date deaf guys. I've never cared for how she treated him and that was the equivalent of kicking a battered dog while its down. I agree that Travis needs help, but even with these people who think they care about him, he's still getting screwed and he knows it and he's angry. He has a right to be. Regina needs to get her crap together and seen that Toby thing a mile away.
-the apprenticeship proposal in all of its platonic glory. Fave moment of the series so far. Again miller is incredible in this role.
-Sherlock's entire speech. But the banter between them pertaining to her safety was a very close second.
-it was nice to see some development. Plus I'm a Breakout Kings fan so it was great seeing Malcolm again. Though bittersweet. :(
-nope. I like them breaking up the monotony. There are tons of murder shows.
-Ecstatic. I appreciated the slow burn. It makes the strength of their bond all the more believable now. They've been on fire the past five or so episodes. The show has really hit its stride. Love it.
@Wednesday. Preach! My sentiments exactly. As far as I'm concerned that little were b!tch can go jump into the Boston harbor and take Liam and Nora with her. I tolerated nora in the beginning because of how josh loved her but then she became a werewolf and the whole thing with the twins and now her blatant disrespect for aidan, who is Josh's family. I mean she's been insufferable since she moved in and took over. That house is too damn crowded. And the preview suggests she won't be and better. I loathe nora. I liked the development with Sally's brother. She and Aidan have been having great little stories. Josh needs something other than playing dad to the disrespectful teen wolf, her convo with josh about him not having say because he isn't want of them? Wanted to smack her. This Liam and Erin business is more of Nora's story than Josh unfortunately.
- I loved the title of the episode. WTF indeed. Huck's "your a natural "was the one scene where I unexpectedly bust out laughing.
- I think part of it is him doing his job. Olivia has her hand in a lot of stuff, I can understand her coming up on his radar. I also think he's fixated on her for his own reasons. So creepy! Love Scott Foley and look forward to where this leads. Ohh when Huck finds out...
-Neither. Crazy Quinnsey has it in her. And Olivia does love her white.
Time jump definitely worked to their advantage. For sure. So far the Huck and Quinn "ship" is called Huckleberry Quinn. I hope there isn't a romance. Quinn always comes across as everyone's super annoying little sister. She's always in the way but she's family so you deal. She's especially that way with Huck. Loved his observation that she's a natural though. I love Huck...and yes he will flip the hell out pull out the "whiskey "when he finds out about the cameras. No one messes with his friend if he can help it. That was so creepy! I was all excited to see Scott Foley and loving their chemistry and then instantly freaked out by the end...but intrigued too. Fitz is out of control. Hate how pathetic he comes across...as though he's incompetent and unable to actually run anything. Prized show horse? Really? Feel for him though. He needs to cut the Scotch.poor David.
This show is amazing! I love it and Rhys is a standout for sure.
Agree with this review completely!! I actually like the friendship between Rayna and Liam. I figured they probably wouldn't hook up so my unmentionables weren't in a twist during the hotel stuff. Her telling him about her divorce rather than Deacon made sense to me. I've come to see them as kindred spirits and solid friends. He has an outsider perspective with no real stakes or expectations. He's just hers...he isn't aligned or invested in anyone else in her circle. Deacon and the double standard. I think most of all he just misses being her confidant. Still love him. He'll get over it. Teddy is the worst. Just ugh. Gunner and co have been more interesting than they were. And Avery is difficult to like.
I soo agree with serenity and grimmfan. I do NOT like clarice. I think she's shady and her husband, shay and her baby will suffer. I hope her husband gets full custody because clarice is just unstable and it is irritating the hell out of me that they have the audacity to think that they can shut this man out of his own child's life! What is that? He hasn't done anything wrong! He isn't the bad guy or the enemy! I don't care for that scenario at all but Kelly looked adorable holding the baby. Oh Dawson. She was more foolish than usual but it'll lead to some interesting stuff that's for sure. Glad Casey kicked his mom out.
I like watching the show but it isn't necessarily suspenseful. There is a predictability to it that drives me mad because it doesn't have to be that way. Eighty percent of the time I feel like I can deduce what is going to happen. I love M. Good. I really do but she's the lead, ...she has to do more, have more of a presence than the painfully, cringeworthy, amateur sleuthing that she does. When Sophia makes a bitchy comment and asks why Joanna is even there...I can't even defend her. I'm inclined to agree. If her backstory and her cover story were stronger it would help matters. Edward has become the most fascinating of the bunch. His father too. Sophi still creeps me out at times. Haverstock is interesting although him being mia father was no surprise. And I'd like to see what it's like now that Joanna has moved in with Julian (also no surprise)
I loathe the Kennish adults, Regina and her mother are only a tad more likeable...regina moreso than her mom. That is probably why the way they treat Angelo is so frustrating to me. Loved him in this episode. I did figure he wanted to raise the kid on his own. I think it would be good for him and he'd be good at it. Plus the unconditional love.I too found melody's speech offensive and yet unsurprising. It's very common and it's why I hold the deaf as responsible as the hearing in perpetuating misunderstanding and prejudice. The fact is there's a difference between speaking positively of whatever group of anything you fall into and putting those different from you down to build yourself up. I like and feel bad for both Noah and Travis. In many ways they'd make spectacular friends. Noah has to accept what's happening to him and let people in. Travis is doing better at that but Daphne has to stop leading him on. And he's so not an angry guy.


text:
|Reviews for Bury the Hatchet: Revised
| TheaLuthor chapter 3 . 8/18/2007
the character commentary is freakin hilarious!
| Woodrokiro chapter 11 . 8/9/2007
"...who ya gonna call?"
"Ghost Busters"
rofl XD. I love this story.
| lusciiousx3hsm chapter 21 . 7/24/2007
i love this story.
| actress2bjess chapter 21 . 3/4/2007
LOVELOVELOVELOVELOVE IT! *becomes obsessed with story* Too...amazing...for words...*keels over*
OK bye.
| Shana chapter 21 . 1/14/2007
OMG, possibly the most beautiful story I've ever read! Although I'm not English AND 14 the understanding went very well for me... Great Job!
Shana x
| Loony chapter 21 . 1/5/2007
*as Ron does his little turn on the catwalk*
I simply love your songs, but why is he too sexy for Hermione and his wand?
Oh yea, and Ron has a REALLY nice deep voice... hahahaha... and I added a little after-thought
"I WILL SURVIVE!" -the dying screams of voldemort as he recalls his hidden horcruxes, but the power of three did what one could not, and he rests in his own bubbling hatred of his father.
| Loony chapter 17 . 1/5/2007
God, I love explanations...
Aww no songs this time?
| Loony chapter 4 . 1/4/2007
Alright, I don't believe that you actually HAVE a half-monkey half-llama type creature in the shadows of your basement, but I'm reviewing anyway: Good Lord, I hope Charles doesn't think Hermione is cheating on him. There, that's it.
| silverjazz chapter 4 . 12/12/2006
I've only just started this chapter, but I'd like to comment before I forget what I want to say. Besides the fact that I already love the story.
So your original characters. Probably the only OCs I can say that I truly love. The boys are fantastic and humorous. Not mentioned too much, and play off Hermione well. And Charles, oh, I love him. He's such a funny, goodhearted fellow. Really, you can't help but love him. I feel no threat to Ron, because Hermione doesn't even like him, but he's such a good guy. Can't wait till I can finish this story.
It's so awkward between Ron and Hermione right now...
| dandan chapter 21 . 12/10/2006
OF COURSE I want Ron to do his little turn on the catwalk!
I love him so much!
Thanks for the story!
Me liked it very much!
| Becca the fiend chapter 21 . 10/20/2006
That was funny. Heh. 'Ron's.. too sexy for his shirt, too sexy for his shirt.' Heh. Those little author notes were pretty funny. And spastic. It was a good fanfiction, too. Like, you'd think at one moment one person was the culprit, and then it'd change. It was really good.
| ConverseGal chapter 17 . 9/24/2006
wow wow wow wow. i really really didn't see that one coming. this is one of the best r/h fics i have read in ages.
| ConverseGal chapter 4 . 9/23/2006
This was great!And I'm not just reviewing cos i'm scared of the half monkey half llama, although that thought does terriffy(crap, that's not how you spell it is it? I really need help with my spelling!) me somewhat(hehe love that word!)
| ConverseGal chapter 2 . 9/23/2006
DA DA DA!OH! CAN'T WAIT TO FIND OUT WHAT HAPPENS NEXT! EH! O.K, MAYBE I'M just A lil BIT OVER EXCITED. AH WELL!
| AmazinglyMe chapter 21 . 7/24/2006
Well, I just read you entire story.
Yep. I did.
And let me tell you something very important.
At first I thought your story was going to be okay. And then I realized that it was not just okay, it was a...
Thoroughly Amazing, Well-Plotted Story
(also known as a TAWPS).
I have to say that one of my fave chapters was the one in which the trio is reuinted. It was just so...*sniffles* AWESOME.
So yeah. I loved it. Big smiles for you.
~ AmazinglyMe


text:
Select Local Merchants
MaidPro BroomfieldRead MoreThough their brand reaches throughout the United States, each MaidPro office is helmed by owners and operators who live in the areas they service. Being a part of their communities drives MaidPro employees to treat their customers' houses as if they were their neighbors, beginning with a pre-session meeting with homeowners to draft a cleaning plan that addresses every area in need of a good scrubbing. Each house is examined based on a comprehensive 49-point checklist that ensures a quality job each time. Additionally, MaidPro only uses cleaning products that customers know and trust to free surfaces from dirt, bacteria, and stains from family food-fight night.266 Basher Drive Unit 8Johnstown, CO US
Drahota Cleaning ServicesRead MoreAt Drahota Cleaning, friendly employees accomplish more than just light dusting and scrubbing; they convert cluttered living spaces into warm, inviting abodes. Organizational and cleaning services do everything from scouring grimy bedrooms, bathrooms, and kitchens to balancing teetering stacks of home-office memos. As cleaners sort and sanitize homes, they make sure to sweep dust from baseboards and blinds to facilitate a better view for the neighborhood watch plastered against the other side of the window.908 Welch AvenueBerthoud, CO US
Noble House Precious InvestmentsRead MoreIf you're on the hunt for engagement or wedding jewelry, Noble House Precious Investments has the largest selection of jewelry in Loveland. The area has many parking options for customers. Whether you're in need of a flashy necklace for that plunging V-neck or something more simple, Noble House Precious Investments' jewelry selection is unbeatable.206 E 29th StLoveland, CO US
Scotchie's CleanersRead MoreIf you're tired of ruining your clothes, then you'll want to take advantage of the great dry cleaning service from Scotchie's Cleaners in Fort Collins to ensure your clothes are dependable for weekly wear. If you find your clothes are in need of a good alteration or mending, check out the excellent tailor service at this bar. Need some further help? bar can help you iron as well when you take advantage of their A+ service. So if you have some clothing that cannot be washed in a washer and dryer, take it over to Scotchie's Cleaners for a professional dry cleaning service.1827 E Mulberry StFort Collins, CO US
Curtis MathesRead MoreAt Curtis Mathes in Fort Collins, shop for new electronics and accessories or take your current machines in for a little TLC. Here you can find a large number of computer options for both work and personal use, including laptops, printer_copier_scanner_string, and smartphones. Make use of the ample parking near Curtis Mathes. For new speakers, TVs, computers, and more, Curtis Mathes delivers everything you want in an electronic device.4848 S College AveFort Collins, CO US
South Shields Dental GroupRead MoreLooking for a new dentist? Try Fort Collins' South Shields Dental Group for professional and affordable dental treatments. With so many great services, dental clinic can even help your smile with fillings, check up, cleaning, crowns and veneers, and teeth whitening. The next time you need to fill a cavity or cure a toothache on the fly, call up South Shields Dental Group.1103 S Shields StFort Collins, CO US


text:
Notting Hill Apartments100 Drew Hill Lane, Chapel Hill, NC 27514
- Call for rates
- 1 - 3 Beds
Note : Prices & Availability Subject To Change
Note : Prices & Availability Subject To Change
Note : Prices & Availability Subject To Change
Rethink the way you live...
Just minutes from the buzz and activity of the Research Triangle Park, Duke University, and UNC-Chapel Hill lies a haven of tranquility at Notting Hill Apartment Community in Chapel Hill, North Carolina. Our gorgeous apartment community is located off of 15-501 near shopping, dining and entertainment in Chapel Hill and Southpoint Mall and is located in the prestigious Chapel Hill city school district. We are just 3 miles from UNC and located on the busline.Notting Hill combines modern conveniences with designer features in our 1, 2, and 3 bedroom apartments. All of our homes boast fully-equipped gourmet kitchens, large balconies, designer bathrooms, walk-in closets, and abundant natural light. Select homes also feature sunrooms and fireplaces.Our luxury amenity package showcases a gorgeous pool pavilion with sundeck and grills, car wash area, lighted tennis courts, 24/7 fitness center and business center. Call today to schedule a personalized tour and reserve your new home!
Notting Hill is located in the Raleigh Area in the 27514 zip code. View this apartment on a map.
Why You'll Love Us
With only 200 units, our size allows for a close-knit community and a quiet location. Notting Hill's layout means there are only two entrances at the front of the property, ensuring privacy and security. Residents enjoy chatting at the coffee bar and utilizing our business center. We're in a walkable location with a nearby golf course, shops, and restaurants.
Professionally Managed By: Carroll Management Group
Community Features
- Community Activities
- Corporate Housing Available
- Business Center
- Natural Wooded Landscaping
- Clubhouse
- On The Busline
- BBQ/Picnic Area
- Fitness/Health Center
- Recycling
- Garage
- Bike Racks
- Laundry
- On Site Maintenance
- OnSiteManagement
- Package Receiving
- Playground
- Pool
- Public Transportation
- Rec Room
- Tennis Court
Floor Plan Amenities
- Air Conditioning
- Balcony
- Ceiling Fans
- Dishwasher
- Disposal
- Dryer
- Extra Storage
- Fireplace
- Microwave
- Furnished Apartment Available
- WiFi Available
- Handrails
- Patio
- Carpeting
- Refrigerator
- Satellite TV
- View
- Washer/Dryer in Unit
*Note: In Select Units


text:
Coaching Staff
John Swanson - Head Coach
This will be John Swanson's first year as Head Coach of the College of the Rockies Men's volleyball program. John was an Assistant Coach with the team last season and is looking forward to the opportunity of continuing to create an elite program with student athletes motivated to perform to their best abilities on and off the volleyball court.
John played three successful years of collegiate volleyball. In his first year at Red Deer College the team competed in the National finals placing second and attended two years at Langara College placing 6th and 2nd respectfully. After John's competitive years, he quickly moved into the field of coaching becoming involved in years of high school and club volleyball. John brings years of experience to the college and appreciates the opportunity presented to him to develop and establish a program capable of contending annually in the Pacwest conference. "It will always be my goal as a Head Coach to encourage and support all of our student athletes in their entire collegiate experience".
Contact John Swanson:
Phone: 250-464-5427
Fax: 250-489-8218
Email: firstname.lastname@example.com
David Wiebe, Assistant Coach
David loves the game of volleyball and is very proud to be able to stay involved with the Avalanche program as this is where he spent his career as a player. This is David's second year as an assistant coach with the men's team and he very much enjoys working with the guys and being able to give back to the program he spent 5 years in as a student athlete.
Connor McCreadie, Assistant Coach
This will be Connor's first season assisting with the women's and men's volleyball program. Connor has six years of volleyball playing experience along with a very successful hockey career. He is extremely passionate about athletics, teaching and motivating others to perform to their peak potential. Connor will be a tremendous addition to the coaching staff.


text:
Men's Rocky ErgoTuff Cool Wellington Boots, Brown
Item # WX2-597363
- Google+
- Details & Specs
Rocky® ErgoTuff Cool Wellington Boots are cool and airy... let your feet breathe! BIG BUCKS OFF!
Never let 'em see you sweat! You certainly won't have to worry about that in these Wellingtons from Rocky! This pair was built with your comfort in mind.
They're called Cool Wellington Boots because of all the ventilation ports along the heel, the sides and the foot that let the cool, refreshing air in, and let the heat out. Plus, these Boots have breathable nylon panels on shaft and a breathable, moisture-wicking CoolMax® fabric lining. The result? Fresh, cool, comfortable feet all day long!Air it out:
State Width: medium or wide; and Size, as available in the Shopping Cart. Cool, fresh feet in Work Boots all day IS possible!
- Durable full-grain leather foot with nylon shaft
- Rocky Air-Port cushioned footbed
- Polyurethane midsole
- Lightweight, flexible ErgoTuff outsole is also oil and slip-resistant
- Triple-screened ventilation chambers.
- Each approx. 11 1/2"h., 22 ozs.
!!! Limited Quantities !!!
- Reviews
Men's Rocky ErgoTuff Cool Wellington Boots, Brown is rated out of 5 by 1.Rated 5 out of 5 by MITCHELL & ALIC from The free shipping was nice, also.Date published: 2014-09-04

 are these boots water proof or resistant?.will the inside fabric tear ?

Asked by: wolfman

 This item is waterproof. We have not heard of any problems from our customers regarding the inside fabric tearing.
Answered by: Customer Service

Date published: 2015-04-02

 Do these boots have any insulation and how much?

Asked by: Charlie

 These are not insulated. They are made for COOLMAX® lined moisture management, which helps keep your feel well ventilated and not overheat.
Answered by: Customer Service

Date published: 2015-02-27

2015-10-03T17:29CST

bvseo_cps, prod_bvqa, vn_cps_3.1.6

cp_1, bvpage1

co_hasquestionsanswers, tq_2

loc_en_US, sid_597363, PRD, sort_recentAnswersFirst

clientName_sportmansguide

- Articles & Tips
Don't Forget
Thorogood Shock Zone InsoleNon-Member $13.99 Buyer's Club $12.59
Peet Boot / Shoe DryerNon-Member $49.99 Buyer's Club $44.99
Softsole Trim-to-fit Boot Laces, Brown / WaxyNon-Member $3.99 Buyer's Club $3.59
You May Also Like
Rocky Ride Waterproof Wellington Work Boots, BrownNon-Member $79.99 Buyer's Club $71.99
Guide Gear Men's Premium 12" Pull-on Work BootsNon-Member $69.99 Buyer's Club $62.99
Guide Gear Men's Premium 11" Pull-on Work Boots, WaterproofNon-Member $79.99 Buyer's Club $71.99


text:
|Publication number
|Publication type
|Application number
|Publication date
|15 Nov 2001
|Filing date
|5 Feb 2001
|Priority date
|18 Feb 2000
|Also published as
|Publication number
|Gregory Moulton, James Zarbock
|Original Assignee
|Moulton Gregory Hagan, Zarbock James John
|Export Citation
|BiBTeX, EndNote, RefMan
|Patent Citations (92), Referenced by (26), Classifications (21), Legal Events (8)
|External Links: USPTO, USPTO Assignment, Espacenet
[0001] 1. Field of the Invention
[0002] The present invention relates, in general, to network data storage, and, more particularly, to software, systems and methods for high availability, high reliability data storage resident at nodes distributed throughout a network topology.
[0003] 2. Relevant Background
[0004] Economic, political, and social power are increasingly managed by data. Transactions and wealth are represented by data. Political power is analyzed and modified based on data. Human interactions and relationships are defined by data exchanges. Hence, the efficient distribution, storage, and management of data is expected to play an increasingly vital role in human society.
[0005] The quantity of data that must be managed, in the form of computer programs, databases, files, and the like, increases exponentially. As computer processing power increases, operating system and application software becomes larger. Moreover, the desire to access larger data sets such as those comprising multimedia files and large databases further increases the quantity of data that is managed. This increasingly large data load must be transported between computing devices and stored in an accessible fashion. The exponential growth rate of data is expected to outpace improvements in communication bandwidth and storage capacity, making the need to handle data management tasks using conventional methods even more urgent.
[0006] Many factors must be balanced and often compromised in conventional data storage systems. Because the quantity of data stored is large and rapidly increasing, there is continuing pressure to reduce cost per bit of storage. Also, data management systems should be sufficiently scaleable to contemplate not only current needs, but future needs as well. Preferably, storage systems are designed to be incrementally scaleable so that a user can purchase only the capacity needed at any particular time. High reliability and high availability are also considered as data users become increasingly intolerant of lost, damaged, and unavailable data. Unfortunately, conventional data management architectures must compromise these factors—no single data architecture provides a cost-effective, highly reliable, highly available, and dynamically scaleable solution.
[0007] Conventional RAID (redundant array of independent disks) systems provide a way to store the same data in different places (thus, redundantly) on multiple storage devices such as hard disks. By placing data on multiple disks, input/output (I/O) operations can overlap in a balanced way, improving performance. Since using multiple disks increases the mean time between failure (MTBF) for the system as a whole, storing data redundantly also increases fault-tolerance. A RAID system relies on a hardware or software controller to hide the complexities of the actual data management so that a RAID systems appear to an operating system to be a single logical hard disk. However, RAID systems are difficult to scale because of physical limitations on the cabling and controllers. Also, RAID systems are highly dependent on the controllers so that when a controller fails, the data stored behind the controller becomes unavailable. Moreover, RAID systems require specialized, rather than commodity hardware, and so tend to be expensive solutions.
[0008] RAID solutions are also relatively expensive to maintain. RAID systems are designed to enable recreation of data on a failed disk or controller but the failed disk must be replaced to restore high availability and high reliability functionality. Until replacement occurs, the system is vulnerable to additional device failures. Condition of the system hardware must be continually monitored and maintenance performed as needed to maintain functionality. Hence, RAID systems must be physically situated so that they are accessible to trained technicians who can perform the maintenance. This limitation makes it difficult to set up a RAID system at a remote location or in a foreign country where suitable technicians would have to be found and/or transported to the RAID equipment to perform maintenance functions.
[0009] NAS (network-attached storage) refers to hard disk storage that is set up with its own network address rather than being attached to an application server. File requests are mapped to the NAS file server. NAS may perform I/o operations using RAID internally (i.e., within a NAS node). NAS may also automate mirroring of data to one or more other NAS devices to further improve fault tolerance. Because NAS devices can be added to a network, they may enable some scaling of the capacity of the storage systems by adding additional NAS nodes. However, NAS devices are constrained in RAID applications to the abilities of conventional RAID controllers. NAS systems do not generally enable mirroring and parity across nodes, and so a single point of failure at a typical NAS node makes all of the data stored at that NAS node unavailable.
[0010] Traditional storage systems, from basic disk-based storage to more complex RAID-type storage, view storage as one or more hardware storage devices under control of a centralized controller. Even in distributed storage systems, all that is distributed is the data—the functionality that implements management and control features tends to be centralized. In such systems data availability is compromised when the centralized controller fails or becomes unavailable for any reason. Moreover, such systems are compromised when network links to the central controller fail or become congested. A need exists for a robust storage architecture that improves immunity to all single points of failure in front of data availability.
[0011] Philosophically, the way data is conventionally managed is inconsistent with the hardware devices and infrastructures that have been developed to manipulate and transport data. For example, computers are characteristically general-purpose machines that are readily programmed to perform a virtually unlimited variety of functions. In large part, however, computers are loaded with a fixed, slowly changing set of data that limits their general-purpose nature to make the machines special-purpose. Advances in processing speed, peripheral performance and data storage capacity are most dramatic in commodity computers and computer components. Yet many data storage solutions cannot take advantage of these advances because they are constrained rather than extended by the storage controllers upon which they are based. Similarly, the Internet was developed as a fault tolerant, multi-path interconnection. However, network resources are conventionally implemented in specific network nodes such that failure of the node makes the resource unavailable despite the fault-tolerance of the network to which the node is connected. Continuing needs exist for highly available, highly reliable, and highly scaleable data storage solutions.
[0012] Briefly stated, the present invention involves a data storage system comprising a plurality of storage nodes. Data storage mechanisms are implemented in each storage node. A communication medium links storage nodes. A quantity of data is distributed across a selected set of the storage nodes such that the quantity of data remains available irrespective of the unavailability of one or more of the storage nodes within the selected set.
[0013] The plurality of network storage nodes are configured as a redundant array of inexpensive nodes (RAIN) system in which each node comprises central processor, network interface, memory, and one or more mass storage devices. The storage nodes are connected to an internal network or data bus. Nodes can be added and removed from the system without making the system or data stored in the system unavailable to an externally connected device or network. The system does not have the single points of failure often characteristic of conventional data storage systems.
[0014] In another aspect, the present invention involves a method of managing data storage in a network comprising multiple storage nodes. When a storage request is communicated to at least one storage node the at least one storage node is caused to implement the storage request using an arbitrary subset of the available storage nodes. State information is communicated between the multiple storage nodes and used to select the arbitrary subset of the multiple storage nodes.
[0015]FIG. 1 shows a networked computer environment in which the present invention is implemented;
[0016]FIG. 2 shows a computing environment in which the present invention is implemented at a different level of detail;
[0017]FIG. 3 illustrates components of a RAIN element in accordance with an embodiment of the present invention; and
[0018]FIG. 4 and FIG. 5 show exemplary organizations of the RAIN elements into a redundant array storage system.
[0019] The present invention is directed to a high availability, high reliability storage system that leverages rapid advances in commodity computing devices and the robust nature of internetwork technology such as the Internet. In general, the present invention involves a redundant array of inexpensive nodes (RAIN) distributed throughout a network topology. Nodes may be located on local area networks (LANs), metropolitan area network (MAN), wide area networks (WANs), or any other network having spatially distanced nodes. Nodes are preferably internetworked using mechanisms such as the Internet. In specific embodiments, at least some nodes are publicly accessible through public networks such as the Internet and the nodes communicate with each other by way of private networks and/or virtual private networks, which may themselves be implemented using Internet resources.
[0020] Significantly, the nodes implement not only storage, but sufficient intelligence to communicate with each other and manage not only their own storage, but storage on other nodes. For example, storage nodes maintain state information describing other storage nodes capabilities, connectivity, capacity, and the like. Also, storage nodes may be enabled to cause storage functions such as read/write functions to be performed on other storage nodes. Traditional storage systems do not allow peer-to-peer type information sharing amongst the storage devices themselves. In contrast, the present invention enables peer-to-peer information exchange and, as a result, implements a significantly more robust system that is highly scaleable. The system is scaleable because, among other reasons, many storage tasks can be implemented in parallel by multiple storage devices. The system is robust because the storage nodes can be globally distributed making the system immune to events in any one or more geographical, political, or network topological location.
[0021] The present invention is implemented in a globally distributed storage system involving storage nodes that are optionally managed by distributed storage allocation management (SAM) processes. The present invention is directed to the architecture and implementation of the storage nodes themselves, and so is not limited to use with the SAM processes. However, the exemplary SAM processes are discussed to the extent they illustrate the performance of the storage node architecture of the present invention.
[0022] The nodes are connected to a network and data is preferably distributed to the nodes in a multi-level, fault-tolerant fashion. In contrast to conventional RAID systems, the present invention enables mirroring and parity operations to be spread across nodes rather than simply across hard drives within a single node. Nodes can be dynamically added to and removed from the system while the data managed by the system remains available. In this manner, the system of the present invention avoids single or multiple failure points in a manner that is orders of magnitude more robust than conventional RAID systems.
[0023] The present invention is illustrated and described in terms of a distributed computing environment such as an enterprise computing system using public communication channels such as the Internet. However, an important feature of the present invention is that it is readily scaled upwardly and downwardly to meet the needs of a particular application. Accordingly, unless specified to the contrary the present invention is applicable to significantly larger, more complex network environments as well as small network environments such as conventional LAN systems.
[0024] The present invention is directed to data storage on a network 101 shown in FIG. 1. FIG. 1 shows an exemplary internetwork environment 101 such as the Internet. The Internet is a global internetwork formed by logical and physical connections between multiple wide area networks (WANs) 103 and local area networks (LANS) 104. An Internet backbone 102 represents the main lines and routers that carry the bulk of the traffic. The backbone is formed by the largest networks in the system that are operated by major Internet service providers (ISPs) such as GTE, MCI, Sprint, UUNet, and America Online, for example. While single connection lines are used to conveniently illustrate WAN 103 and LAN 104 connections to the Internet backbone 102, it should be understood that in reality multi-path, routable wired and/or wireless connections exist between multiple WANs 103 and LANs 104. This makes internetwork 101 robust when faced with single or multiple failure points.
[0025] It is important to distinguish network connections from internal data pathways implemented between peripheral devices within a computer. A "network" comprises a system of general purpose, usually switched, physical connections that enable logical connections between processes operating on nodes 105. The physical connections implemented by a network are typically independent of the logical connections that are established between processes using the network. In this manner, a heterogeneous set of processes ranging from file transfer, mail transfer, and the like can use the same physical network. Conversely, the network can be formed from a heterogeneous set of physical network technologies that are invisible to the logically connected processes using the network. Because the logical connection between processes implemented by a network is independent of the physical connection, internetworks are readily scaled to a virtually unlimited number of nodes over long distances.
[0026] In contrast, internal data pathways such as a system bus, Peripheral Component Interconnect (PCI) bus, Intelligent Drive Electronics (IDE) bus, Small Computer System Interface (SCSI) bus, Fibre Channel, and the like define physical connections that implement special-purpose connections within a computer system. These connections implement physical connections between physical devices as opposed to logical connections between processes. These physical connections are characterized by limited distance between components, limited number of devices that can be coupled to the connection, and constrained format of devices that can be connected over the connection.
[0027] To generalize the above discussion, the term "network" as it is used herein refers to a means enabling a physical and logical connection between devices that 1) enables at least some of the devices to communicate with external sources, and 2) enables the devices to communicate with each other. It is contemplated that some of the internal data pathways described above could be modified to implement the peer-to-peer style communication of the present invention, however, such functionality is not currently available in commodity components. Moreover, such modification, while useful, would fail to realize the full potential of the present invention as storage nodes implemented across, for example, a SCSI bus would inherently lack the level of physical and topological diversity that can be achieved with the present invention.
[0028] Referring again to FIG. 1, the present invention is implemented by placing storage devices at nodes 105. The storage at any node 105 may comprise a single hard drive, may comprise a managed storage system such as a conventional RAID device having multiple hard drives configured as a single logical volume, or may comprise any reasonable hardware configuration spanned by these possibilities. Significantly, the present invention manages redundancy operations across nodes, as opposed to within nodes, so that the specific configuration of the storage within any given node can be varied significantly without departing from the present invention.
[0029] Optionally, one or more nodes such as nodes 106 implement storage allocation management (SAM) processes that manage data storage across multiple nodes 105 in a distributed, collaborative fashion. SAM processes may be implemented in a centralized fashion within special-purpose nodes 106. Alternatively, SAM processes are implemented within some or all of RAIN nodes 105. The SAM processes communicate with each other and handle access to the actual storage devices within any particular RAIN node 105. The capabilities, distribution, and connections provided by the RAIN nodes 105 in accordance with the present invention enable storage processes (e.g., SAM processes) to operate with little or no centralized control for the system as whole.
[0030] In a particular implementation, SAM processes provide data distribution across nodes 105 and implement recovery in a fault-tolerant fashion across network nodes 105 in a manner similar to paradigms found in PAID storage subsystems. However, because SAM processes operate across nodes rather than within a single node or within a single computer, they allow for greater levels of fault tolerance and storage efficiency than those that may be achieved using conventional PAID systems. Moreover, it is not simply that the SAM processes operate across network nodes, but also that SAM processes are themselves distributed in a highly parallel and redundant manner, especially when implemented within some or all of the nodes 105. By way of this distribution of functionality as well as data, failure of any node or group of nodes will be much less likely to affect the overall availability of stored data.
[0031] For example, SAM processes can recover even when a network node 105, LAN 104, or WAN 103 becomes unavailable. Moreover, even when a portion of the Internet backbone 102 becomes unavailable through failure or congestion the SAM processes can recover using data distributed on nodes 105 and functionality that is distributed on the various SAM nodes 106 that remain accessible. In this manner, the present invention leverages the robust nature of internetworks to provide unprecedented availability, reliability, and robustness.
[0032]FIG. 2 shows an alternate view of an exemplary network computing environment in which the present invention is implemented. Internetwork 101 enables the interconnection of a heterogeneous set of computing devices and mechanisms ranging from a supercomputer or data center 201 to a hand-held or pen-based device 206. While such devices have disparate data storage needs, they share an ability to retrieve data via network 101 and operate on that data using their own resources. Disparate computing devices including mainframe computers (e.g., VAX station 202 and IBM AS/400 station 208) as well as personal computer or workstation class devices such as IBM compatible device 203, Macintosh device 204 and laptop computer 205 are easily interconnected via internetwork 101. The present invention also contemplates wireless device connections to devices such as cell phones, laptop computers, pagers, hand held computers, and the like.
[0033] Internet-based network 213 comprises a set of logical connections, some of which are made through internetwork 101, between a plurality of internal networks 214. Conceptually, Internet-based network 213 is akin to a WAN 103 in that it enables logical connections between spatially distant nodes. Internet-based networks 213 may be implemented using the Internet or other public and private WAN technologies including leased lines, Fibre Channel, frame relay, and the like.
[0034] Similarly, internal networks 214 are conceptually akin to LANs 104 shown in FIG. 1 in that they enable logical connections across more limited distances than those allowed by a WAN 103. Internal networks 214 may be implemented using LAN technologies including Ethernet, Fiber Distributed Data Interface (FDDI), Token Ring, Appletalk, Fibre Channel, and the like.
[0035] Each internal network 214 connects one or more RAIN elements 215 to implement RAIN nodes 105. RAIN elements 215 illustrate an exemplary instance of hardware/software platform that implements a RAIN node 105. Conversely, a RAIN node 105 refers to a more abstract logical entity that illustrates the presence of the RAIN functionality to external network users. Each RAIN element 215 comprises a processor, memory, and one or more mass storage devices such as hard disks. RAIN elements 215 also include hard disk controllers that may be conventional EIDE or SCSI controllers, or may be managing controllers such as RAID controllers. RAIN elements 215 may be physically dispersed or co-located in one or more racks sharing resources such as cooling and power. Each node 105 is independent of other nodes 105 in that failure or unavailability of one node 105 does not affect availability of other nodes 105, and data stored on one node 105 may be reconstructed from data stored on other nodes 105.
[0036] The perspective provided by FIG. 2 is highly physical and it should be kept in mind that physical implementation of the present invention may take a variety of forms. The multi-tiered network structure of FIG. 2 may be altered to a single tier in which all RAIN nodes 105 communicate directly with the Internet. Alternatively, three or more network tiers may be present with RAIN nodes 105 clustered behind any given tier. A significant feature of the present invention is that it is readily adaptable to these heterogeneous implementations.
[0037] RAIN elements 215 are shown in greater detail in FIG. 3. In a particular implementation, RAIN elements 215 comprise computers using commodity components such as Intel-based microprocessors 301 mounted on a motherboard supporting a PCI bus 303 and 128 megabytes of random access memory (RAM) 302 housed in a conventional AT or ATX case. SCSI or IDE controllers 306 may be implemented on the motherboard and/or by expansion cards connected to the PCI bus 303. Where the controllers 306 are implemented only on the motherboard, a PCI expansion bus 303 is optional. In a particular implementation, the motherboard implements two mastering EIDE channels and an PCI expansion card is used to implement two additional mastering EIDE channels so that each RAIN element 215 includes up to four EIDE hard disks 307. In the particular implementation, each hard disk 307 comprises an 80 gigabyte hard disk for a total storage capacity of 320 gigabyte per RAIN element 215. The casing also houses supporting mechanisms such as power supplies and cooling devices (not shown).
[0038] The specific implementation discussed above is readily modified to meet the needs of a particular application. Because the present invention uses network methods to communicate with the storage nodes, the particular implementation of the storage node is largely hidden from the devices using the storage nodes, making the present invention uniquely receptive to modification of node configuration and highly tolerant of systems comprised by heterogeneous storage node configurations. For example, processor type, speed, instruction set architecture, and the like can be modified and may vary from node to node. The hard disk capacity and configuration within RAIN elements 215 can be readily increased or decreased to meet the needs of a particular application. Although mass storage is implemented using magnetic hard disks, other types of mass storage devices such as magneto-optical, optical disk, digital optical tape, holographic storage, atomic force probe storage and the like can be used as suitable equivalents as they become increasingly available. Memory configurations including RAM capacity, RAM speed, RAM type (e.g., DRAM, SRAM, SDRAM) can vary from node to node making the present invention incrementally upgradeable to take advantage of new technologies and component pricing. Network interface components may be provided in the form of expansion cards coupled to a mother board or built into a mother board and may operate with a variety of available interface speeds (e.g., 10 BaseT Ethernet, 100 BaseT Ethernet, Gigabit Ethernet, 56K analog modem) and can provide varying levels of buffering, protocol stack processing, and the like.
[0039] Specifically, it is contemplated that the processing power, memory, network connectivity and other features of the implementation shown in FIG. 3 could be integrated within a disk drive controller and actually integrated within the housing of a disk drive itself. In such a configuration, a RAIN element 215 might be deployed simply by connecting such an integrated device to an available network, and multiple RAIN elements 215 might be housed in a single physical enclosure.
[0040] Each RAIN element 215 may execute an operating system. The particular implementations use a UNIX operating system (OS) or UNIX-variant OS such as Linux. It is contemplated, however, that other operating systems including DOS, Microsoft Windows, Apple Macintosh OS, OS/2, Microsoft Windows NT and the like may be equivalently substituted with predictable changes in performance. Moreover, special purpose lightweight operating systems or micro kernels may also be used, although cost of development of such operating systems may be prohibitive. The operating system chosen implements a platform for executing application software and processes, mechanisms for accessing a network, and mechanisms for accessing mass storage. Optionally, the OS supports a storage allocation system for the mass storage via the hard disk controller(s).
[0041] Various application software and processes can be implemented on each RAIN element 215 to provide network connectivity via a network interface 304 using appropriate network protocols such as User Datagram Protocol (UDP), Transmission Control Protocol (TCP), Internet Protocol (IP), Token Ring, Asynchronous Transfer Mode (ATM), and the like.
[0042] In the particular embodiments, the data stored in any particular node 105 can be recovered using data at one or more other nodes 105 using data recovery and storage management processes. These data recovery and storage management processes preferably execute on a node 106 and/or on one of the nodes 105 separate from the particular node 105 upon which the data is stored. Conceptually, storage management is provided across an arbitrary set of nodes 105 that may be coupled to separate, independent internal networks 215 via internetwork 213. This increases availability and reliability in that one or more internal networks 214 can fail or become unavailable due to congestion or other events without affecting the overall availability of data.
[0043] In an elemental form, each RAIN element 215 has some superficial similarity to a network attached storage (NAS) device. However, because the RAIN elements 215 work cooperatively, the functionality of a RAIN system comprising multiple cooperating RAIN elements 215 is significantly greater than a conventional NAS device. Further, each RAIN element preferably supports data structures that enable parity operations across nodes 105 (as opposed to within nodes 105). These data structures enable operation akin to RAID operation, however, because the RAIN operations are distributed across nodes and the nodes are logically, but not necessarily physically connected, the RAIN operations are significantly more fault tolerant and reliable than conventional RAID systems.
[0044]FIG. 4 illustrates an exemplary storage allocation management system including SAM processes 401 that provides an exemplary mechanism for managing storage held in RAIN nodes 105. SAM processes may vary in complexity and implementation to meet the needs of a particular application. SAM processes 401 may vary in complexity from relatively simple file system type processes to more complex redundant array storage processes involving multiple RAIN nodes 105. SAM processes may be provided within a storage-using client, within a separate network node 106, or within some or all of RAIN nodes 105. In a basic form, SAM processes 401 implements a network interface 404 to communicate with, for example, network 101, processes to exchange state information with other storage nodes 105 and store the state information in a state information data structure 402, and to read and write data on other storage nodes 105. These basic functions enable a plurality of storage nodes 105 to coordinate their actions to implement a virtual storage substrate layer upon which more complex SAM processes can be implemented.
[0045] In a more complex form, contemplated SAM processes 401 comprise a plurality of SAM processes that provide a set of functions for managing storage held in multiple RAIN nodes 105 and are used to coordinate, facilitate, and manage participating nodes 105 in a collective manner. This coordination enables the underlying configuration, location, cost, and other individual characteristics of each node 105 to be optionally hidden from client programs using the SAM processes 401. In this manner, SAM processes 401 may realize benefits in the form of greater access speeds, distributed high speed data processing, increased security, greater storage capacity, lower storage cost, increased reliability and availability, decreased administrative costs, and the like.
[0046] In the particular example of FIG. 4, SAM processes are conveniently implemented as network-connected servers that receive storage requests from a network-attached file system. Network interface processes 404 may implement a first interface for receiving storage requests from a public network such as the Internet. In addition, network interface may implement a second interface for communicating with other storage nodes 105. The second interface may be, for example, a virtual private network. For convenience, a server implementing SAM processes is referred to as a SAM node 106, however, it should be understood from the above discussion that a SAM node 106 may in actuality be physically implemented on the same machine as a client or RAIN node 105. An initial request can be directed at any server implementing SAM processes, or the file system may be reconfigured to direct the access request at a particular SAM node 106. When the initial server does not does not respond, the access request is desirably redirected to one or more alternative SAM nodes 106 and/or RAIN nodes 105 implementing SAM processes.
[0047] Storage request processing involves implementation of an interface or protocol that is used for requesting services or servicing requests between nodes or between SAM processes and clients of SAM processes. This protocol can be between SAM processes executing on a single node, but is more commonly between nodes running over a network, typically the Internet. Requests indicate, for example, the type and size of data to be stored, characteristic frequency of read and write access, constraints of physical or topological locality, cost constraints, and similar data that taken together characterize desired data storage performance characteristics.
[0048] Storage requests are handled by storage request processes 402 which operate to generate read/write commands in view of system state information 403. Storage request processes include processing requests for storage access, identification and allocation/de-allocation of storage capacity, migration of data between storage nodes 105, redundancy synchronization between redundant data copies, and the like. SAM processes 401 preferably abstract or hide the underlying configuration, location, cost, and other context information of each RAIN node 105 from data users. SAM processes also enable a degree of fault tolerance that is greater than any storage node in isolation as parity is spread out in a configurable manner across multiple storage nodes that are geographically, politically, and network topologically dispersed.
[0049]FIG. 5 shows an exemplary storage system in accordance with the present invention from another perspective. Client 503 represents any of a number of network appliances that may use the storage system in accordance with the present invention. Client 503 uses a file system or other means for generating storage requests directed to one of accessible storage nodes 215. Not all storage nodes 215 need to be accessible through Internet 101. In one implementation, client 503 makes a storage request to a domain name using HyperText Transport Protocol (HTTP), Secure HyperText Transport Protocol (HTTPS), File Transfer Protocol (FTP), or the like. The Internet Domain Name System (DNS) will resolve the storage request to a particular IP address identifying a specific storage node 215 that implements the SAM processes 401. Client 503 then directs the actual storage request using a mutual protocol to the identified IP address.
[0050] The storage request is directed using network routing resources to a storage node 215 assigned to the IP address. This storage node then conducts storage operations (i.e., data read and write transactions) on mass storage devices implemented in the storage node 215, or on any other storage node 215 that can be reached over an explicit or virtual private network 501. Some storage nodes 215 may be clustered as shown in the lower left side of FIG. 5., and clustered storage nodes may be accessible through another storage node 215.
[0051] Preferably, all storage nodes are enabled to exchange state information via private network 501. Private network 501 is implemented as a virtual private network over Internet 101 in the particular examples. In the particular examples, each storage node 215 can send and receive state information. However, it is contemplated that in some applications some storage nodes 215 may need only to send their state information while other nodes 215 act to send and receive storage information. The system state information may be exchanged universally such that all storage nodes 215 contain a consistent set of state information about all other storage nodes 215. Alternatively, some or all storage nodes 215 may only have information about a subset of storage nodes 215.
[0052] Another feature of the present invention involves the installation and maintenance of RAIN systems such as that shown in FIG. 5. Unlike conventional RAID systems, a RAIN system enables data to be cast out over multiple, geographically diverse nodes. RAIN elements and systems will often be located at great distances from the technical resources needed to perform maintenance such as replacing failed controllers or disks. While the commodity hardware and software at any particular RAIN node 105 is highly reliable, it is contemplated that failures will occur.
[0053] Using appropriate RAIN protections, data is spread across multiple RAIN nodes 105 and/or multiple RAIN systems as described above. In event of a failure of one RAIN element 215, RAIN node 105, or RAIN system, high availability and high reliability functionality can be restored by accessing an alternate RAIN node 105 or RAIN system. At one level, this reduces the criticality of a failure so that it can be addressed days, weeks, or months after the failure without affecting system performance. At another level, it is contemplated that failures may never need to be addressed. In other words, a failed disk might never be used or repaired. This eliminates the need to deploy technical resources to distant locations. In theory, a RAIN node 105 can be set up and allowed to run for its entire lifetime without maintenance.
[0054] RAIN nodes 105 desirably implement a "heartbeat" process that informs other RAIN nodes or storage management processes of their existence and their state of operation. For example, when a PAIN node 105 is attached to a network 214 or 215, the heartbeat message indicates that the PAIN node 105 is available, and notifies of its available storage. The RAIN node 105 can report disk failures that require parity operations. Loss of the heartbeat will result in reconstruction of an entire node at an alternate node. In a particular implementation, the heartbeat message is unicast to a single management node, or multicast or broadcast to a plurality of management nodes every several minutes or days. The broadcast may be scheduled at regular or irregular intervals, or may occur on a pseudorandom schedule. The heartbeat message includes information such as the network address of the RAIN node 105, storage capacity, state information, maintenance information and the like.
[0055] Although the invention has been described and illustrated with a certain degree of particularity, it is understood that the present disclosure has been made only by way of example, and that numerous changes in the combination and arrangement of parts can be resorted to by those skilled in the art without departing from the spirit and scope of the invention, as hereinafter claimed.
|Cited Patent
|Filing date
|Publication date
|12 Jun 1970
|6 Jun 1972
|File access system
|23 Oct 1978
|29 Jul 1980
|International Business Machines Corporation
|Hash index table hash generator apparatus
|28 Feb 1985
|10 Mar 1987
|International Business Machines Corp.
|Device driver and adapter binding technique
|12 Jun 1986
|2 Aug 1988
|International Business Machines Corporation
|Parity spreading to enhance storage access
|13 Feb 1987
|12 Dec 1989
|International Business Machines Corporation
|System and method for accessing remote files in a distributed networking environment
|3 Dec 1987
|12 Dec 1989
|Symbolics, Inc.
|Symbolic language data processing system
|13 Feb 1987
|30 Jan 1990
|International Business Machines Corporation
|System and method for using cached data at a local node after re-opening a file at a remote node in a distributed networking environment
|30 Apr 1986
|13 Feb 1990
|International Business Machines Corporation
|Method and apparatus for application software control of echo response
|19 Dec 1988
|1 Jan 1991
|International Business Machines Corporation
|Method of and system for using device drivers to couple the communication and data storage of remote computer systems
|8 Sep 1987
|2 Apr 1991
|Digital Equipment Corporation
|Arrangement with cooperating management server node and network service node
|26 Jan 1989
|21 May 1991
|Ibm Corporation
|Allocating data storage space of peripheral data storage devices using implied allocation based on user parameters
|23 Jan 1989
|18 Feb 1992
|Vortex Systems, Inc.
|Fault tolerant computer backup system
|28 Sep 1987
|28 Apr 1992
|At&T Bell Laboratories
|User and application program transparent resource sharing multiple computer interface architecture with kernel process level transfer of user requested services
|27 Jul 1989
|21 Jul 1992
|Personal Computer Peripherals Corporation
|Backup computer program for networks
|6 Sep 1988
|8 Sep 1992
|Digital Equipment Corporation
|Remote bootstrapping a node over communication link by initially requesting remote storage access program which emulates local disk to load other programs
|19 Nov 1990
|13 Oct 1992
|Storage Technology Corporation
|Multilevel, hierarchical, dynamically mapped data storage subsystem
|19 Oct 1990
|10 Nov 1992
|Allen-Bradley Company, Inc.
|Remote downloading and uploading of motion control program information to and from a motion control I/O module in a programmable controller
|11 Aug 1989
|10 Nov 1992
|Digital Equipment Corporation
|File backup system for producing a backup copy of a file which may be updated during backup
|12 Sep 1990
|11 May 1993
|Storage Technology Corporation
|Incremental disk backup system for a dynamically mapped data storage subsystem
|5 Feb 1990
|8 Jun 1993
|Epoch Systems, Inc.
|File server system having high-speed write execution
|30 Jun 1989
|24 Aug 1993
|Digital Equipment Corporation
|Digital data management system for maintaining consistency of data in a shadow set
|7 Sep 1990
|24 Aug 1993
|International Business Machines Corporation
|Data storage hierarchy with shared storage level
|19 Jun 1991
|24 Aug 1993
|Storage Technology Corporation
|Phantom duplex copy group apparatus for a disk drive array data storge subsystem
|20 Apr 1992
|16 Nov 1993
|International Business Machines Corporation
|Method and system for incremental time zero backup copying of data
|19 Dec 1989
|4 Jan 1994
|Epoch Systems, Inc.
|Digital data processor with improved backup storage
|19 Dec 1989
|4 Jan 1994
|Epoch Systems, Inc.
|Digital data storage system with improved data migration
|18 Jun 1991
|11 Jan 1994
|Ibm Corp.
|Recovery from errors in a redundant array of disk drives
|30 Aug 1991
|19 Apr 1994
|Digital Equipment Corporation
|Predictive cache system
|7 Sep 1990
|31 May 1994
|International Business Machines Corporation
|Storage management of a first file system using a second file system containing surrogate files and catalog management information
|4 Sep 1991
|28 Jun 1994
|Storage Technology Corporation
|Intelligent storage manager for data storage apparatus having simulation capability
|28 Jun 1991
|13 Sep 1994
|Digital Equipment Corporation
|System for reconstructing prior versions of indexes using records indicating changes between successive versions of the indexes
|13 Oct 1992
|11 Oct 1994
|Auspex Systems, Inc.
|Parallel I/O network file server architecture
|26 Mar 1992
|22 Nov 1994
|International Business Machines Corporation
|Self-tuning virtual storage management for dedicated real-time computer system
|31 Oct 1991
|22 Nov 1994
|Epoch Systems, Inc.
|Network file migration system
|30 Sep 1993
|3 Jan 1995
|Hitachi, Ltd.
|Highly reliable online system
|2 Sep 1992
|4 Apr 1995
|Storage Technology Corporation
|File server having snapshot application data groups
|3 Dec 1992
|4 Apr 1995
|Unisys Corporation
|Data base backup and recovery system and method
|31 Dec 1992
|4 Apr 1995
|Unisys Corporation
|System and method for remote program load
|20 Apr 1992
|5 Sep 1995
|International Business Machines Corporation
|Method and system for time zero backup session security
|16 Jul 1993
|19 Sep 1995
|Zitel Corporation
|Method and structure for evaluating and enhancing the performance of cache memory systems
|10 Dec 1991
|19 Sep 1995
|Digital Equipment Corporation
|Generic remote boot for networked workstations by creating local bootable code image
|25 Jul 1989
|26 Sep 1995
|International Business Machines Corporation
|CPU implemented method for backing up modified data sets in non-volatile store for recovery in the event of CPU failure
|30 Mar 1993
|26 Dec 1995
|Squibb Data Systems, Inc.
|Apparatus and method for reconstructing a file from a difference signature and an original file
|4 Dec 1992
|23 Jan 1996
|At&T Global Information Solutions Company
|Concurrent image backup for disk storage system
|23 Sep 1992
|5 Mar 1996
|International Business Machines Corporation
|Method and system for track transfer control during concurrent copy operations in a data processing storage subsystem
|27 Jan 1995
|30 Apr 1996
|Auspex Systems, Inc.
|Fault tolerant NFS server system and mirroring protocol
|30 Sep 1993
|7 May 1996
|Sybase, Inc.
|Data backup system with methods for stripe affinity backup to multiple archive devices
|21 Apr 1993
|4 Jun 1996
|Oracle Corporation
|Methods and apparatus for optimizing undo log usage
|25 Feb 1994
|9 Jul 1996
|Oki Electric Industry Co., Ltd.
|Data processing system for locally updating customer data distributed by a host computer to a remote facility and for returning the updated customer data to the host computer
|7 Jun 1995
|6 Aug 1996
|Konrad; Allan M.
|Remote information service access system based on a client-server-service model
|27 Jun 1995
|24 Sep 1996
|Lucent Technologies Inc.
|Incremental computer file backup using check words
|24 Oct 1994
|12 Nov 1996
|International Business Machines Corporation
|System and method for reducing storage requirement in backup subsystems utilizing segmented compression and differencing
|2 Jun 1995
|17 Dec 1996
|Beck; Robert E.
|Workgroup organized network manager with workstation comparison system
|14 Mar 1995
|18 Feb 1997
|Network Integrity, Inc.
|Continuously-snapshotted protection of computer files
|7 Jun 1995
|25 Feb 1997
|Digital Equipment Corporation
|Temporary state preservation for a distributed file service
|6 Jun 1995
|17 Jun 1997
|International Business Machines Corporation
|Computerized method and system for replicating a database using log records
|9 Nov 1995
|15 Jul 1997
|Legent Corporation
|System and method for distributed storage management on networked computer systems using binary object identifiers
|22 Apr 1993
|19 Aug 1997
|Microsoft Corporation
|Multiple level undo/redo mechanism
|31 Mar 1995
|18 Nov 1997
|Emc Corporation
|Distributed storage array system having a plurality of modular control units
|24 May 1996
|9 Dec 1997
|Konrad; Allan M.
|Remote information service access system based on a client-server-service model
|13 May 1996
|12 May 1998
|Fujitsu Limited
|Checking for proper locations of storage devices in a storage device array
|14 Dec 1995
|19 May 1998
|Sun Microsystems, Inc.
|Method and system for accessing chunks of data using matching of an access tab and hashing code to generate a suggested storage location
|11 Jan 1996
|9 Jun 1998
|Connected Corporation
|High performance backup via selective file saving which can perform incremental backups and exclude files and uses a changed block signature list
|4 Nov 1993
|23 Jun 1998
|Crawford; Christopher M.
|Internet online backup system provides remote storage for customers using IDs and passwords which were interactively established when signing up for backup services
|23 Oct 1995
|7 Jul 1998
|Stac, Inc.
|System for backing up files from disk volumes on multiple nodes of a computer network
|3 Dec 1996
|11 Aug 1998
|Fairbanks Systems Group
|Incremental computer file backup using a two-step comparison of first two characters in the block and a signature with pre-stored character and signature sets
|15 Nov 1991
|1 Sep 1998
|Fujitsu Limited
|Background data reconstruction in a storage device array system
|3 Jul 1995
|1 Sep 1998
|Sun Microsystems, Inc.
|Client-server computer system and method utilizing a local client disk drive as a data cache
|12 Mar 1997
|8 Sep 1998
|Oracle Corporation
|Method and apparatus for scalable, high bandwidth storage retrieval and transportation of multimedia data on a network
|13 Oct 1995
|20 Oct 1998
|Digital Equipment Corporation
|Reconstructing data blocks in a raid array data storage system having storage device metadata and raid set metadata
|29 Dec 1995
|9 Feb 1999
|Scientific-Atlanta, Inc.
|Method and apparatus for providing conditional access in connection-oriented, interactive networks with a multiplicity of service providers
|13 Oct 1995
|3 Aug 1999
|Digital Equipment Corporation
|Promoting device level error to raidset level error to restore redundacy in a raid array data storage system
|28 Jun 1996
|26 Oct 1999
|Digital Equipment Corporation
|Enabling mirror, nonmirror and partial mirror cache modes in a dual cache system
|24 Oct 1997
|2 Nov 1999
|Kinetech, Inc.
|Data processing system using substantially unique identifiers to identify data items, whereby identical data items have the same identifiers
|1 Apr 1997
|7 Dec 1999
|Gadzoox Networks, Inc.
|Hierarchical storage management from a mirrored file system on a storage network segmented by a bridge
|16 May 1998
|11 Jan 2000
|Fairbanks Systems Group
|System and method for backing up computer files over a wide area computer network
|26 Jun 1998
|18 Jan 2000
|Wild File, Inc.
|Method, software and apparatus for saving, using and recovering data
|23 Jan 1998
|22 Feb 2000
|Tricord Systems, Inc.
|Decentralized file mapping in a striped network file system in a distributed computing environment
|1 Oct 1997
|16 May 2000
|Microsoft Corporation
|System and method for secure font subset distribution
|1 Oct 1998
|4 Jul 2000
|Vinca Corporation
|Comparing mass storage devices through digests that are representative of stored data in order to minimize data transfer
|22 May 1998
|19 Sep 2000
|International Business Machines Corporation
|Method and system for data recovery using a distributed and scalable data structure
|5 Feb 1999
|23 Oct 2001
|Digital Fountain, Inc.
|Information additive code generator and decoder for communication systems
|17 Sep 1999
|20 Nov 2001
|Digital Fountain
|Information additive group code generator and decoder for communications systems
|17 May 1999
|12 Mar 2002
|Compaq Computer Corporation
|System and method for selectively presenting logical storage units to multiple host operating systems in a networked computing system
|18 Dec 1998
|21 May 2002
|Cisco Technology, Inc.
|Representing and verifying network management policies using collective constraints
|30 Mar 2000
|4 Nov 2003
|Hewlett-Packard Development Company, L.P.
|Controller-based bi-directional remote copy system with storage site failover capability
|7 Mar 2000
|25 Nov 2003
|International Business Machine Corporation
|Using multiple controllers together to create data spans
|18 Nov 1996
|22 Jun 2004
|Mci Communications Corporation
|System and method for a directory service supporting a hybrid communication system architecture
|16 Oct 2001
|6 Jul 2004
|Sun Microsystems, Inc.
|Community separation control in a multi-community node
|4 Jan 2002
|17 Aug 2004
|Worldcom, Inc.
|Intelligent network
|18 Jan 2000
|4 Jan 2005
|International Business Machines Corporation
|Method, system, program, and data structures for mapping logical blocks to physical blocks
|5 Apr 1999
|21 Mar 2002
|Theodore E. Bruning
|Apparatus and method for providing very large virtual storage volumes using redundant arrays of disks
|Citing Patent
|Filing date
|Publication date
|16 Jul 2004
|29 Aug 2006
|Hitachi, Ltd.
|Control system of NAS, backup method, and program therefor
|20 Sep 2002
|19 Sep 2006
|Polyserve, Inc.
|System and method for journal recovery for multinode environments
|20 Sep 2002
|12 Dec 2006
|Polyserve, Inc.
|System and method for synchronization for enforcing mutual exclusion among multiple negotiators
|20 Sep 2002
|3 Jul 2007
|Kingsbury Brent A
|System and method for implementing journaling in a multi-node environment
|20 Sep 2002
|4 Sep 2007
|Hewlett-Packard Development Company, L.P.
|System and method for efficient lock recovery
|12 Nov 2004
|20 Nov 2007
|Sprint Communications Company L.P.
|Computing asset management system and method
|20 Sep 2002
|14 Oct 2008
|Hewlett-Packard Development Company, L.P.
|System and method for a multi-node environment with shared storage
|29 Nov 2004
|21 Oct 2008
|Honeywell International Inc.
|Fault tolerant communication apparatus
|27 Feb 2006
|24 Aug 2010
|Symantec Operating Corporation
|Redundancy management service for peer-to-peer networks
|23 May 2006
|28 Aug 2012
|Noryan Holding Corporation
|Distributed storage
|17 Nov 2008
|13 Nov 2012
|International Business Machines Corporation
|Apparatus and program storage device for providing triad copy of storage data
|30 Jun 2003
|11 Nov 2014
|Symantec Operating Corporation
|Goal-oriented storage management for a distributed data storage network
|24 Oct 2008
|23 Jun 2015
|Hewlett-Packard Development Company, L.P.
|Detecting duplicative hierarchical sets of files
|26 Sep 2002
|1 Apr 2004
|Hitachi Ltd.
|Resource distribution management method over inter-networks
|24 Oct 2003
|12 Aug 2004
|The Board Of Governors For Higher Education, State Of Rhode Island And Providence Plantations
|Distributed raid and location independence caching system
|14 Oct 2004
|16 Jun 2005
|Margolus Norman H.
|Data repository and method for promoting network storage of data
|16 Jul 2004
|6 Oct 2005
|Nobuyuki Saika
|Control system of NAS, backup method, and program therefor
|7 Oct 2005
|13 Apr 2006
|Philip Cacayorin
|Devices and methods for implementing cryptographic scrambling
|7 Oct 2005
|13 Apr 2006
|Philip Cacayorin
|Floating vector scrambling methods and apparatus
|7 Oct 2005
|13 Apr 2006
|Philip Cacayorin
|Dispersed data storage using cryptographic scrambling
|12 Oct 2004
|13 Apr 2006
|Hickman John E
|Apparatus, system, and method for facilitating storage management
|29 Nov 2004
|17 Aug 2006
|Honeywell International Inc.
|Fault tolerant communication apparatus
|24 Aug 2006
|14 Dec 2006
|Moon Jang W
|Nonstop service system using voting, and information updating and providing method in the same
|24 Oct 2008
|6 May 2010
|Forman George H
|Detecting Duplicative Hierarchical Sets Of Files
|20 Sep 2002
|3 Jul 2003
|Polyserve Inc
|A system and method for management of a storage area network
|19 Jul 2012
|31 Jan 2013
|Xiotech Corporation
|Resilent mirroring utilizing peer-to-peer storage
|U.S. Classification
|International Classification
|Cooperative Classification
|European Classification
|25 Jun 2001
Owner name: UNDOO, INC., A DELAWARE CORPORATION, CALIFORNIA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MOULTON, GREGORY HAGAN;ZARBOCK, JAMES JOHN;REEL/FRAME:011933/0663
Effective date: 20010619
|5 Oct 2001
Owner name: AVAMAR TECHNOLOGIES, INC., CALIFORNIA
Free format text: CHANGE OF NAME;ASSIGNOR:UNDOO, INC.;REEL/FRAME:012244/0447
Effective date: 20010615
|22 Jun 2002
Owner name: COMERCIA BANK-CALIFORNIA SUCCESSOR IN INTEREST TO
Free format text: SECURITY AGREEMENT;ASSIGNOR:AVAMAR TECHNOLOGIES, INC., FORMERLY KNOWN AS UNDOO, INC.;REEL/FRAME:013261/0729
Effective date: 20010202
|23 Sep 2003
Owner name: VENTURE LENDING & LEASING III, INC., CALIFORNIA
Free format text: SECURITY INTEREST;ASSIGNOR:AVAMAR TECHNOLOGIES, INC.;REEL/FRAME:014541/0725
Effective date: 20030829
|24 Jun 2005
Owner name: VENTURE LENDING & LEASING IV, INC., CALIFORNIA
Free format text: SECURITY AGREEMENT;ASSIGNOR:AVAMAR TECHNOLOGIES, INC.;REEL/FRAME:016718/0008
Effective date: 20050506
|7 Mar 2007
Owner name: EMC CORPORATION, MASSACHUSETTS
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AVAMAR TECHNOLOGIES, INC.;REEL/FRAME:018972/0254
Effective date: 20061111
|14 Dec 2009
|Fee payment
Year of fee payment: 4
|13 Dec 2013
|Fee payment
Year of fee payment: 8


text:
The Style Gallery is a great new way for you to view, love, and share outfit photos. It's meant to showcase
all the expressive, creative, and inspirational personalities of our community!
Love you too!
Your email has been sent!
Vintage circa 1960's, these pink and white sandals are perfect for adding retro flair to your summer ensembles!
Let us know if you need it! We reorder based on community feedback and demand, so your voice is very important. We'll email you if we can bring it back.
Remarkable fashion & decor, inspired by our community, & delivered with uncommon care.
Copyright ©2002-2015 ModCloth.com. All Rights Reserved.
Site Map
CA Notice
Privacy & Security
Terms of Use


text:
SUMMARY: Many marketers dont realize that direct response radio can reach incremental audiences -- not just the same prospects youll find online or in print. As a marketing channel, radio is appealing because of its combination of high reach, high targetability and low cost.
We talked to an expert about how to plan for and create a radio campaign. Includes costs, radio demographics and copywriting tips. Plus, measuring response and pitfalls to avoid.
Get the latest research on email, lead gen, and social media along with MarketingSherpa updates and promotions.
B2B External Communications: How IBM conveys the value of complex products, spotlights innovative employees and entrusts employees with social media
Watch Now »
The Challenger Customer by Adamson, Dixon, Spenner and Toman
Enter for Your Chance to Win »


text:
Latest on Arthur Juda Cohen »
Faisal Shaikh, handed the death sentence in the 11/7 train bombing case, on Wednesday requested the prison authorities not to transfer him from the Arthur Road jail since his statement in the 2006 Aurangabad arms haul case is being recorded and the c
Japanese scientist Takaaki Kajita and Canadian physicist Arthur B McDonald have won the Nobel prize in Physics 2015 "for the discovery of neutrino oscillations, which shows that neutrinos have mass".
The Maharashtra government on Wednesday informed the Bombay high court that it would check if it was feasible to shift Pune German Bakery blasts lone convict Himayat Baig could be shifted to a prison in Mumbai.
The Maharashtra government on Wednesday informed the Bombay high court that it would check if it was feasible to shift Pune German Bakery blasts lone convict Himayat Baig could be shifted to a prison in Mumbai.
Chandran, an IIT Roorkee graduate, has won the fellowship for his work in "transforming wastewater from a pollutant requiring disposal to a resource for useful products, such as commodity chemicals, energy sources, and fertilisers."
Crime branch on Tuesday questioned Margao municipal council (MMC) chairperson Arthur D'Silva for nearly two hours to ascertain whether he had an authority letter from former chief minister Digambar Kamat to file and receive information under RTI conn
Zabiuddin Ansari aka Abu Jindal, the alleged 26/11 handler and accused in German Bakery blast who has been on a self imposed fast to protest his confinement to a special solitary confinement at Arthur Road, was taken to JJ hospital for a medical chec
Crime branch of the Goa police on Sunday once again summoned former chief minister Digambar Kamat and Margao muncipal council chairperson Arthur D'Silva to be present at crime branch office on Monday for investigation after adding Section 201 of IPC
Arthur Morris, an opening batsman who played 46 Tests for Australia and was a key member of Don Bradman's 1948 "Invincibles'' has died, Cricket Australia said.
The Goa unit of the Aam Aadmi Party (AAP) on Tuesday petitioned the directorate of municipal administration (DMA) to immediately dissolve the Margao municipal council (MMC) to prevent further draining of the exchequer funds being paid as salaries to
Recommended by Colombia
Photos »
There are no related Photos.
Videos »
There are no related Videos.


text:
Is this attraction free to the public?
Is gratuity suggested at this attraction?
Would this be a good rainy day activity?
Is there food available at this attraction?
Is a car required to access this attraction?
Is this attraction accessible using public transportation?
Is this attraction closed during certain parts of the year?
Does this attraction require payment to access?
Do you recommend that visitors take a guided tour at this attraction?
Is this attraction wheelchair accessible?
Thanks for helping!
We stop every year to research our genealogy--gr8 research assistance. Small museum with a wonderful staff.
Downstairs is like walking back in time 100 or more years ago---rooms and manicans were set and dressed for the day
upstairs my family and I were able to dig back in time for our lineage that came from Digby and beyond with the masterful guidance and help of the assistants at the museum. We had already quite a bit...
While in town doing some family history research, we decided to pop into the Genealogy research area upstairs. The staff are very helpful and knowledgeable.
a small museum with a gift shop gives some of the fishing history and family history of the area the guide was excellent and friendly
For the size of town, it was really well done. We enjoyed our time there. If you have ancestors from the area, they offer very inexpensive research/
Even just getting to the Admiral Digby Museum is a trip and I mean trip in a wonderful way. The landscape and the people are simply amazing. Spend some time wondering about and it's a stop you'll soon forget. If you have time take some time to visit Bear River - that seaside village is a whole another world altogether.
I live in Nova Scotia and most summer weekends I visit different region and visit the local museums. Admiral Digby Museum is small but interestiong it is about the local history some militaria, the sea and sailboats.
It is well organised and worth the visit, mainly for the ones that want to know about the local history. Some very nice...
Located on the main street diagonally across from the visitor's center, Admiral Digby's Museum is worth a visit. It is a house with some rooms set up as rooms i.e. the living room and the bedroom and some rooms used to display exhibits. In the back of the house on the first floor is a display of military uniforms that...
It's a small museum for a small town.
Will give you an idea of local history.
Has a cool costume room with cloths from the 1900s
This is a small museum but it makes up for it by showing an appetizing slice of Digby history. The rooms' exhibits and information are well planned and explain much about the notable families, economy and history of the town. The staff are extremely helpful and knowledgeable, and for anyone doing genealogical research - this is a perfect place.
Own or manage this property? Claim your listing for free to respond to reviews, update your profile and much more.